Smart System with Descriptive Video Service and Spoken Dialogue System for Visually Impaired Individuals

One of the biggest challenges for those with visual impairments is traveling alone. Even though smart helping sticks for the blind have been developed, individuals still need to carry them, and their limits mean that the challenges faced by the visually handicapped go unaddressed. This project offers a more intelligent fix for these problems. The goal of the proposed project is to create system that can automatically guide blind persons through daily living. With the use of deep learning and fusion of sensors algorithms, the developed system's camera captures a live feed of the surroundings and recognizes the sorts of obstacles that a blind user is likely to face. Auditory warnings notify the blind when barriers are present. The recommended design also uses OCR techniques to read the boards and their messages to help blind people. The project also includes speech recognition for voice aided navigation, making it completely failproof and enabling blind individuals to use GPS for voice-based navigation. Thus, in order to provide a full solution for the blind, this work combines sensor fusion with deep learning.