Touchless Mouse Control Via Hand Gestures Using Resnet and Mediapipe

Touchless control of systems using hand gestures is a trending technology in the field of Human-Computer Interaction (HCI). One of the most common ways to interact with systems is through the mouse. In this paper, a touchless mouse is focus on, which can perform the same operations as a physical mouse using finger and hand gestures. All of these operations are carry out by the system without requiring any external devices. In the physical mouse, we hold and operate it using the index and middle fingers. Similarly, we use the same hand pose to control the touchless mouse system. Nowadays, every system has an inbuilt webcam. This system uses a low-resolution webcam as input to capture hand gestures with 21 landmarks using OpenCV and MediaPipe. Based on the movements of the landmarks in the hand, the cursor can navigate, and various actions such as right-click, left-click, double-click, zoom in and zoom out, drag and drop files, multiselect files, increase, and decrease volume, adjusting the brightness, are easily performed, ResNet18 is used to stop the cursor movement. Using different finger and hand gestures. The system has the potential to replace traditional HCI tools in the future and help optimize hu-man-computer communication.