Illumination independent recognition of deictic arm postures

This paper presents VisBoS, a visual system for detecting the 3D location of descriptive body landmarks (shoulder, elbow, wrist) out of stereo images using neural networks. The user is standing in front of a projection wall and interacts with a virtual construction scenario. Using whole arm gestures, the user can select and manipulate objects in the scene. Since we need a nearly dark room for displaying on the wall, the camera system had to make use of nonvisible light. This is achieved by combining infrared illumination together with a suitable filter.