Object Detection for Assisting Blind Individuals Using ESP32-CAM and GPS

The purpose of this study is to develop a conceptual framework of assistive technologies that will help meet the objective of increasing the independence and safety of visually impaired persons. This framework is based on recent innovations in object detection, depth sensing, and communication for real-time spatial awareness and response. To increase efficiency in gathering the environment data the system combines several hardware components such as a high frame rate web camera, infrared depth sensor as well as ESP32-CAM microcontroller board that plays a crucial role in capturing visions and spatial data. The object detection feature, which forms the basis of the system, uses the YOLO algorithm a prominent algorithm in real-time object recognition and localization that allows the framework to quickly identify and locate objects in the user’s environment. From the software side, the sensor inclusion and data treatment are maintained with ordinary C++ of the Arduino-Based hardware. The companion application is built with React Native and is best suited to Android platforms with additional nice features of its user-friendly interface. These are major features of this application which include notification or warning to the user of the obstacles, landmarks, or areas of interest around the environment. Also, the system under development has incorporated real-time GPS tracking so that the attendant or family members can have an idea of where the user is at any given time, giving more security. Featuring an innovative compact and wheelable design, this mobility solution aims to decrease the level of reliance of the visually impaired individual on mechanized aids or human guidance assistance with activities such as walking and getting around during daily activities in unknown territories. Thus, this work brings the advanced sensory and notification technologies in one small pocket device which is an actual and practical invention solely serving to enhance the lives of visually impaired citizens. Not only does this innovative approach thus improve individual liberty but it also demonstrates how assistive technologies can deliver better options for mobility for people with vision impairments, from a safety perspective.