MST-READI

(Medical Simulation TRaining TEchnology EvAluation DesIgner)

A Plauralistic Walkthrough is an inspection methodology used to identify usability issues by having representative users, product developers, and human factors engineers step through a task scenario, discussing usability issues associated with user interactions involved in the scenario steps.  For a training system the walkthrough would involve completing all or part of the training, and the users may be represented/supplemented by instructors.  Additionally, depending on the particular evaluation context and the results of the evaluations conducted at the design stage the training research program manager or the instructional designer may also wish to attend the walkthrough.

The group is asked to assume the role of typical users.  The method allows for the detection of a greater number of usability problems to be found at one time due to the interaction of multiple types of participants. This type of usability inspection method also usually has the additional objective of increasing developers’ sensitivity to users’ concerns about the system design.

Training system developers answer questions about design and suggest solutions to interface problems users have encountered. Human factors professionals usually serve as the facilitators and are also there to provide feedback on the design as well as recommend design improvements. The role of the facilitator is to guide users through tasks and facilitate collaboration between users and developers. It is best to avoid having a system developer assume the role of facilitator, as they can get defensive to criticism of their product.

Participants are presented with the next output/feedback from the simulation interface and asked to write down the action they would take in pursuing the designated task before any discussion occurs.  This approach helps avoid group think and also generates data that can be analyzed.  After all participants have written down the actions they would take discussion begins, with the representative users offering their answers first.

The MST-READI methodology includes a pluralistic evaluation template to help with an evaluation at this stage in the development life-cycle.

References

Bias, Randolph G., "The Pluralistic Usability Walkthrough: Coordinated Emphathies," in Nielsen, Jakob, and Mack, R. eds, Usability Inspection Methods. New York, NY: John Wiley and Sons. 1994.

       MST-READI is a collaborative research effort among US Army RDECOM-STTC, OSDi and CWS, funded by RDECOM-STTC