Interaction with Large Screen Display using Fingertip & Virtual Touch Screen

Human-Computer Interaction (HCI) involves the study, planning, design and uses of the interaction between people (users) and computers. We present a nonintrusive system based on computer vision for human-computer interaction controlled by finger pointing gestures. A new approach for Interaction with Large Screen Display using Fingertip & Virtual Touch Screen by taking into account the location of the user and the interaction area available. We can estimate an interaction surface of virtual touch screen between the display and the user which is scalable and flexible. The distance between the operator and the virtual touch screen can be changed and the operator can be varied. Users can use their pointing finger to interact with the display as if it was brought forward and presented directly in front of them, while preserving viewing angle. Users are allowed to walk around in a room and manipulate information displayed on its walls by using their own finger as a pointing devices. Once captured and tracked in real-time using stereo vision camera, finger pointing gestures are remapped onto the current point of interest, thus reproducing in an advanced interaction scenario the “drag and click” behavior of traditional mice. It's a simple signal processing on images obtained from a regular laptop web-camera.