User evaluation of augmented reality systems

Augmented reality (AR) systems need to be evaluated for their appropriateness for a given task. Three approaches are used to evaluate the waterpump augmented reality tool (WART). The system is assessed using verbal protocol, performance time and a questionnaire. The WART system is compared with a paper version of the assembly instructions. The verbal protocol revealed that there was more cognitive processing for the paper version of task than WART, it took longer to complete the task with WART than the paper version and the questionnaire revealed the effect on performance of problems associated with AR. All of the participants in the evaluation, however, were positive about WART, and appreciated its usefulness.