User's Gaze Tracking System and Its Application Using Head Pose Estimation

In many practical situations, a desirable user interface to a computer system should have a model of where a person is looking at and what user is paying attention to. This is particularly important if a system is providing multi modal communication cues, speech, gesture and the system must identify, whether the cues are aimed at it, or at someone else in the room. In this paper, we describes a system that identifies user focus of attention by visually determining where a person is looking. Our system consists of three steps. First, the head region was estimated and tracked from color image and depth map. Second, the position and orientation of head was estimated using random forests classifier. Due to this classifier, system can be operated in real time and deal with the large set of training data. Finally, calculate the position of user's gaze on the display device.