Speech Activated Virtual Cursor Using NLP

Like many fields of human-computer interaction (HCI), the tech world is moving towards hands-free computer control at an unprecedented pace. Systems that allow users to operate computers without any physical devices - referred to as virtual mice - have received a lot of focus recently as they can significantly improve usability. In this paper, I describe in detail the new methods of virtual mouse control using voice and gesture recognition. The advanced voice command understanding and hand gesture tracking in this project are handled by modern NLP and computer vision methods, respectively. The system was tested on a self-collected dataset, and the results show a high rate of accuracy in voice command processing, as well as in real-time precise cursor movements. Different metrics, namely response time and accuracy level and the overall user experience, all point to the soundness of the system. Combining voice assistance with hand movement tracking makes this system really easy to use and greatly broadens the possible categories of users for hands-free interaction with computers. This makes the device highly useful to both general users and those restricted in some form.