Improving acceptance of the PANTHEON System by training End Users in its use.

The development of technological systems for specific end users requires their involvement in the design and development process, as well as their active participation in validating the resulting technology. To this end, pilot trials are usually implemented, in which the technology is deployed in the intended work environments, and the selected end users are responsible for using, testing and validating it. One objective of this activity is to obtain feedback from potential users in order to evaluate what is known as “technology acceptance”. Multiple studies have concluded that end users’ unwillingness to use information systems (i.e. not accepting these systems) is the main reason for failure in terms of the actual implementation of
technological innovations.
“Perceived usefulness” and “ease of use” have been identified as key factors in predicting user
acceptance of a system. In other words, to guarantee the success of a system, end users must
perceive it as useful for improving their job performance and easy to learn to use. While there is
broad consensus on the significant influence of these two variables, the impact of other factors
has also recently been demonstrated, including end-user training.
Several studies have demonstrated the increasing importance of adequate training in fostering
the intention to use, and consequently, the actual adoption of technological systems. Training
end users in the use of a given system has been shown to influence the aforementioned two
variables. Training end users makes it easier for them to use the system in their daily work (in
our case, the pilots), thereby increasing their perception of its usefulness. With this in mind, the
PANTHEON project developed an end-user training workshop on using the PANTHEON
system, delivered just before the Table Top Exercises (TTXs) that served as the basis for the
pilots. To this end, we implemented a three-step training design methodology:
- Definition of actors, tasks and objectives. The aim of this phase was to define training
needs. To achieve this, we identified the primary actors who would be directly involved
in the TTXs and determined the tasks they would perform when interacting with the
PANTHEON system. Based on these tasks, we identified the knowledge, skills and
attitudes required by users to operate the system effectively, and established the training
objectives. - Development and implementation of the training programme. Drawing on the
information gathered through the training needs assessment, we defined the content of
the training programme and developed supporting materials for those responsible for
delivering it. This included presentations on the project in general, the PANTHEON
system and its components, and the disaster and operational scenarios through which
the system was to be tested and validated. We also developed a brief user manual in
leaflet form, which included a description of the system components for each use case
scenario, as well as an outline of the tasks to be performed. The training seminars took
place on the day of the pilots in Athens and Vienna, just before the start of each TTXs. - Evaluation of the training seminar. The aim of evaluating the training workshop was
to receive feedback from its attendees in order to improve certain elements of the
training. We used questionnaires to measure satisfaction with the different components
of the workshop, such as the content, trainers and support material, as well as the
experience as a whole. We also assessed learning by asking about the perceived
difficulty of the tasks performed during the TTX and the perceived usefulness of the
system in their jobs.
The preliminary analysis of the results of the evaluation has revealed some very positive effects,
which will soon be available in “D8.5 – Report on Training and Pilot Execution”.
