Virtual Mouse to Enhance User Experience and Increase Accessibility

A User Interface is a form of establishing a platform in which a human interacts with machines. There have been different types of user interfaces evolving over the period in line with the rapid growth of technology. Some of the most popular input devices used are mice, keyboards, touchscreens and styluses. A graphical interface is user friendly and, as a result, is widely used. Systems of contactless communication surfaces for interactions have been introduced to decrease the spread of germs and combat diseases like covid-19. This system also can be utilized by disabled people who still retain motor function in the hand and forearm. This paper put forward an AI-assisted virtual mouse system where these drawbacks are solved by utilizing a webcam/built-in camera for recording the motions of the hand and translating them into mouse actions via ML algorithms. The mouse actions are performed based on hand gestures, which are used to control the computer virtually. The hand detection algorithm is based on a deep learning model. So, the proposed system can reduce the spread of germs and help a computer be more accessible to people with special needs.