Hand-based interaction in augmented reality

Interaction with virtual objects in an augmented environment enhances the user's interpretation of their presence. An augmented reality (AR) system that uses computer vision for registration can use the same technology for simple gesture recognition. This paper describes hand detection and simple gesture recognition techniques useful in pattern-based AR systems. Pattern-based registration is briefly discussed followed by the details of hand extraction and analysis. The paper concludes with an application of these techniques using windows-based programming.