Detecting Human Driver Inattentive and Aggressive Driving Behavior Using Deep Learning: Recent Advances, Requirements and Open Challenges

Human drivers have different driving styles, experiences, and emotions due to unique driving characteristics, exhibiting their own driving behaviors and habits. Various research efforts have approached the problem of detecting abnormal human driver behavior with the aid of capturing and analyzing the face of driver and vehicle dynamics via image and video processing but the traditional methods are not capable of capturing complex temporal features of driving behaviors. However, with the advent of deep learning algorithms, a significant amount of research has also been conducted to predict and analyze driver's behavior or action related information using neural network algorithms. In this paper, we contribute to first classify and discuss Human Driver Inattentive Driving Behavior (HIDB) into two major categories, Driver Distraction (DD), Driver Fatigue (DF), or Drowsiness (DFD). Then we discuss the causes and effects of another human risky driving behavior called Aggressive Driving behavior (ADB). Aggressive driving Behavior (ADB) is a broad group of dangerous and aggressive driving styles that lead to severe accidents. Human abnormal driving behaviors DD, DFD, and ADB are affected by various factors including driver experience/inexperience of driving, age, and gender or illness. The study of the effects of these factors that may lead to deterioration in the driving skills and performance of a human driver is out of the scope of this paper. After describing the background of deep learning and its algorithms, we present an in-depth investigation of most recent deep learning-based systems, algorithms, and techniques for the detection of Distraction, Fatigue/Drowsiness, and Aggressiveness of a human driver. We attempt to achieve a comprehensive understanding of HIADB detection by presenting a detailed comparative analysis of all the recent techniques. Moreover, we highlight the fundamental requirements. Finally, we present and discuss some significant and essential open research challenges as future directions.