Smart Driver Assistance for Traffic Sign, Pothole, Vehicle Malfunction, and Accident Detection

Reducing ever-increasing road accidents is a big concern worldwide. Sri Lanka had the highest rate of road fatalities in the past few years, rapidly increasing daily. Among many factors, traffic signs, potholes, and vehicle mechanical malfunctions significantly impact road safety. Most accidents result from a lack of awareness, ignorance, and negligence of drivers. While many high-end vehicles are equipped with technologies such as intelligent road sign recognition systems and air suspension systems, most cars in the market only come with basic driving instruments. Therefore, there is a need for a universal driver assistance system that can be plugged into any vehicle to assist drivers in minimising road casualties. To this end, this study discusses Neural Networks, Machine Learning and IoT technologies to develop an intelligent system that is capable of detecting and analysing road signs, road potholes, vehicles’ internal system malfunctions, and road accidents and notifying drivers in real-time and inform authorities such as hospitals and police stations to be aware of accidents to minimise further casualties. This portable device is based on a Raspberry Pi microprocessor. It uses a web camera, an onboard diagnostic tool (OBD) and an accelerometer to process traffic sign footages, vehicle sensor data and movement data of the vehicle. Yielded results showed that the proposed system was 90% accurate.