Voice and Gesture based Virtual Desktop Assistant for Physically Challenged People

In the modern era computers are becoming faster, smarter and better. Their usage is rising in the fields such as medicine, business administration, education etc. So there is a need for simplifying the operability and usability of a computer. Digital virtual assistants are known for easing the interaction with computers. Since most of the digital virtual assistants use voice as mode of communication deaf and dumb persons are finding it difficult to use virtual assistants on their devices. This research work attempts to propose a voice and gesture based virtual assistant that can be used by disabled as well as non disabled persons to perform common tasks on their computers. The main aim of this research paper is to develop natural human-machine interaction. Input to the virtual assistant is the user's choice. Users can choose to communicate using voice and gestures or operate a mouse pointer using gestures. In thee proposed system, gestures are recognized even in low light conditions. So, the proposed system is very much helpful in all day conditions. It can be of great help in times like Covid-19 pandemic to be contact free as well as for people with disabilities.