Yawning detection for determining driver drowsiness

A system aiming at detecting driver drowsiness or fatigue on the basis of video analysis is presented. The focus of this paper is on how to extract driver yawning. A real time face detector is implemented to locate driver's face region. Subsequently, Kalman filter is adapted to track face region. Further, mouth window is localized within face region and degree of mouth openness is extracted based on mouth features to determine driver yawning in video. The system will reinitialize when occlusion or miss-detect on happen. Experiments are conducted to evaluate the validity of the described method.