Control of A Virtual System with Hand Gestures

In the field of Human-Computer Interaction (HCI), significant advancements have been made. These advancements aim to bridge the gap between the physical and digital realms by introducing various modules. Traditional techniques predominantly involve relocating the tracking ball or adding buttons to the mouse. However, our proposed solution offers novel mouse control options. Our solution incorporates hand tracking, marker motion tracking, and colored object tracking to facilitate movement. The primary focus of this research proposal revolves around mouse cursor movement, as well as click event-based object detection and marker identification. It demonstrates how computer vision technologies, using cameras, can perform all the functions that a mouse currently accomplishes (e.g., left/right click, double-click, scroll, etc.), including tasks like picture segmentation and gesture recognition. Gesture identification poses a challenging problem that necessitates a diverse range of techniques such as motion modeling, motion analysis, pattern recognition, and machine learning. For instance, the ability to click and move the mouse can be achieved through the recognition of colored objects. The fundamental objective of this approach is to utilize a webcam to construct a virtual device for human-computer interaction. A method for recognizing hand movements and their associated gestures has been developed, encompassing all relevant elements. Consequently, numerous mouse operations can be performed when motion is recognized.