A Real-TimeWearable Projector-Wiimote-System for Augmented Reality Interaction Scenarios on Plane Objects

This paper presents a wearable setup and a real-time, intuitive Augmented Reality (AR) interaction technique, designed as interface for a computer or a robot. The system presented consists of a miniaturized projector and up to 2 Wii Remotes (Wiimotes) mounted on a helmet. After a four-point touch calibration with an infrared-pen the user can interact on a flat plane e.g. a wall, table or whiteboard. A maximum of 4 IR-pens can be used at the same time to navigate, select and manipulate objects in the projected virtual space in either 2D or 3D. Under certain light conditions it is also possible to augment virtual informations onto arbitrary flat objects. In case of tracking an IR-pen, keystone distortion can be realised by additional semi-automated user calibration. When using a whiteboard, the calibration is done automatically.