Integrating Natural Language Processing & Computer Vision into an Interactive Learning Platform

Virtual learning platforms are digital interfaces that allow educators and learners to communicate and share resources to facilitate learning. Currently, many of them fail to retain engagement amongst a wide demographic of students. Barriers such as language differences and poor digital literacy often make platforms difficult to use. The purpose of this research was to create a comprehensive learning platform by incorporating Natural Language Processing (NLP) and Computer Vision (CV) to promote an improved user experience through human-computer interactions and graphics. The platform was developed in Python using the Google Speech Recognition API for NLP and the OpenCV library for image processing. After integrating these features into the socket server platform, they were rigorously tested for accuracy to assess the success of a more comprehensive learning environment.