Drowsiness Detection System for Masked Face Based on Deep Neural Network and Haar Cascade

Nowadays, technology is growing rapidly followed by modernization. Face detection technology is one technology that has been developed and applied in various sectors such as biometrics recognition systems, retrieval systems, database indexing in digital video, security systems with restricted area access control, video conferencing, and human interaction systems. Eye detection is a further development of face detection in which the image of a human face was detected to be processed by detecting the location of both eyes on the face. Nowadays, the eye detection system can be used as a means of developing more complex applications and can be applied directly in the aspect of technology that uses eye detection like, eye state detection system, drowsiness and fatigue detection system, safety driving support systems or driver assistance system. In this study we propose drowsiness detection system utilizing current novel classification model such as Deep Neural Network (DNN), combined with Haar Cascade. The DNN is utilized to detect face, while Haar Cascade is utilized for detecting the eyes and its state on the detected face. In this study, due to Covid19 pandemic, we focused on developing the classifiers for detecting the face with mask. Apart from that, our proposed classifiers are also capable of identifying non-masked faces. The experimental result showed that by utilizing DNN and Haar Cascade, our proposed system could reach accuracy, precision, recall, and f1 measure as much as 81%, 88%, 80%, and 84%, respectively.