By Topic

An approach to automatic recognition of spontaneous facial actions

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

5 Author(s)
B. Braathen ; Inst. for Neural Comput., Univ. of California, San Diego, CA, USA ; M. S. Bartlett ; G. Littlewort ; E. Smith
more authors

Presents work on a project for the automatic recognition of spontaneous facial actions. Spontaneous facial expressions differ substantially from posed expressions, similar to how spontaneous speech differs from directed speech. Previous methods for automatic facial expression recognition assumed images were collected in controlled environments in which the subjects deliberately faced the camera. Since people often nod or turn their heads, automatic recognition of spontaneous facial behavior requires methods for handling out-of-image-plane head rotations. There are many promising approaches to address the problem of out-of-image plane rotations. In this paper, we explore an approach based on 3D warping of images into canonical views. A front-end system was developed that jointly estimates camera parameters, head geometry and 3D head pose across entire sequences of video images. First, a small set of images was used to estimate camera parameters and 3D face geometry. Markov-chain Monte-Carlo methods were then used to recover the most likely sequence of 3D poses given a sequence of video images. Once the 3D pose was known, we warped each image into frontal views with a canonical face geometry. We evaluated the performance of the approach as a front-end for a spontaneous expression recognition system using support vector machines and hidden Markov models. This system employed general-purpose learning mechanisms that can be applied to recognition of any facial movement. We showed that 3D tracking and warping, followed by machine learning techniques directly applied to the warped images, is a viable and promising technology for automatic facial expression recognition. One exciting aspect of the approach presented is that information about movement dynamics emerged out of filters which were derived from the statistics of images.

Published in:

Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on

Date of Conference:

21-21 May 2002