Sharing Hand Gesture and Sketch Cues with a Touch User Interface

Summary

This chapter explores the use of the combination of raw hand gestures and sketch cues in an AR interface for remote collaboration. It describes the setup of a user study to evaluate shared gestures and the effects of sketches in remote collaboration. The chapter introduces and investigates the use of HandsInTouch system. It presents a user study by comparing the HandsInTouch system to a condition using only hand gestures. The study results showed that users were positive about the usability of HandsInTouch for remote guidance and found that adding sketching cues was useful for complex collaborative tasks. The chapter also discusses suggestions for designing a remote guidance system and the limitations of author's work.