A gaze tracking scheme for eye-based intelligent control

In this paper, an intelligent control scheme based on remote gaze tracking is proposed. First, the eye-moving video of the user is captured by ordinary resolution camera under the illumination of near infrared light sources, then the images of the eye region and the pupil region are extracted by processing the video in real time. We process the image of the pupil region, and get the coordinates of the pupil center and the corneal glints produced by the infrared light sources. The coordinates of the points on the screen that the user is observing are computed by the gaze-tracking algorithm based on cross-ratio-invariant, and a procedure of calibration is needed to eliminate the error produced by the deviation of the optical and visual axes of the eyeball. Finally, the gaze is tracked in real-time. The results show that the accuracy of the gaze tracking system is about 0.327 degree horizontally and 0.300 degree vertically, which is better than most gaze tracking system reported in other papers.