Human-Computer Interaction Using Fingertip Based on Kinect

Controlling the computer through the hand and eye is a new type human-computer interaction, which overcomes the problem of insufficient flexibility in controlling the traditional computer through the mouse and keyboard. This kind of human-computer interaction is more natural and is an inevitable trend of human-computer interaction in the future. The Kinect based hand-eye positioning system is capable of quickly locating the hand-eye position through depth images and color images, and has a strong real-time performance. Kinect based gesture recognition is widely used in human-computer interaction systems, and the Xbox system developed by Microsoft is the most representative. However, these gesture recognition systems do not pay attention to the problem of finger positioning. From finger positioning point of view, this paper solves the precise position of the finger on the screen by homogeneous coordinate transformation, and realizes a complete set of human-computer interaction system based on hand-eye positioning with simple gesture recognition.