A method of real-time gesture recognition for interactive systems

This paper presents a new method for real-time gesture recognition and its application. The key idea of the method is that we use multiple template models for specific feature parts of body such as arms and estimate the pose of this part by considering similarities of an input image to the models. To calculate the similarity for the part, we developed maskable template model (MTM) with which both masking and template matching are done simultaneously. As an application of this method, we realize a real-time interactive system, gesture game system, which can activate the characters of video game by gestures in real-time.