SMART Virtual Painter and Mouse System to Improve Online Education with Computer Vision and Deep Learning Features

The world of digitization and technological breakthroughs brings about significant changes in business, education, living styles, daily activities, the medical field, and the food industry. The author of this paper presents a novel approach for the computerized academic era in which various obstacles, such as sudden illnesses, natural disasters, and viruses, are not viewed as obstacles but rather serve as inspiration for the development of innovative techniques that improve remote learning and virtual learning. The main goal is to do away with the requirement for physical devices by employing hand gestures to manage the mouse’s functions and position of the cursor. It is implemented using Python and OpenCV, and it uses a webcam as the input device. In order to manage the movement of the cursor and initiate click events, the system monitors hand gestures, extracts characteristics from the hand region, and classes these features. The goal of the suggested system is to offer a practical and affordable alternative for human-computer interaction, especially for those who are physically limited. Mouse activities are made possible by this technology, which recognizes and follows the movements of the pointer on the screen. In a similar vein, the virtual Painter’s goal is to generate a virtual drawing canvas using human fingertips as colour markers and an interface that enables morphological actions between the user and the system. The following sections include the presentation of the technological components, execution, analysis of several associated research factors, and results: section 1 gives brief idea about the introduction and motivation to do this specific research, section II describes the related methods. Section III presents the proposed method, section V shows the implementation of proposed work and concluding part represented by section VI.