Vision-Based Interface: Using Face and Eye Blinking Tracking with Camera

To provide new type of interaction between human-machine, many devices which could substitute input equipments (e.g. mouse, keyboard etc.) have been invented. In this paper, we develop a novel robust camera mouse based on common Webcam which could be used by handicapped, or be used in some special application. We choose common Webcam to build the device in order to ensure the universality of our design. Combination between optical flow and Harris corner detector obtains good result, and an approach based on tracking fix feature point is used to detect eye blinking. The application can be applied to various illuminations even in a house with no lamp but only screen light. At the same time, this method just takes up less than 30% of system resource. Based on our approach we will present a library from which anybody could develop more application.