By Topic

A virtual mirror interface using real-time robust face tracking

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Darrell, T. ; Interval Res. Corp., Palo Alto, CA, USA ; Gordon, G. ; Woodfill, J. ; Harville, M.

We describe a virtual mirror interface which can react to people using robust, real-time face tracking. Our display can directly combine a user's face with various graphical effects, performed only on the face region in the image. We have demonstrated our system in crowded environments with open and moving backgrounds. Robust performance is achieved using multi-modal integration, combining stereo, color and grey-scale pattern matching modules into a single real-time system. Stereo processing is used to isolate the figure of a user from other objects and people in the background. Skin-hue classification identifies and tracks likely body parts within the foreground region. Face pattern detection discriminates and localizes the face within the tracked body parts. We show an initial application of the mirror where the user sees his or her face distorted into various comic poses. Qualitatively, users of the system felt the display “knew” where their face was, and provided entertaining imagery. We discuss the failure modes of the individual components, and quantitatively analyze the face localization performance of the complete system with thousands of users in recent trials

Published in:

Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on

Date of Conference:

14-16 Apr 1998