A vision system for observing and extracting facial actionparameters
Essa, I.A.; Pentland, A.
Computer Vision and Pattern Recognition, 1994. Proceedings CVPR apos;94., 1994 IEEE Computer Society Conference on
Volume , Issue , 21-23 Jun 1994 Page(s):76 - 83
Digital Object Identifier 10.1109/CVPR.1994.323813
Summary:We describe a computer vision system for observing the
“action units” of a face using video sequences as input. The
visual observation (sensing) is achieved by using an optimal estimation
optical flow method coupled with a geometric and a physical (muscle)
model describing the facial structure. This modeling results in a
time-varying spatial patterning of facial shape and a parametric
representation of the independent muscle action groups, responsible for
the observed facial motions. These muscle action patterns may then be
used for analysis, interpretation, and synthesis. Thus, by interpreting
facial motions within a physics-based optimal estimation framework, a
new control model of facial movement is developed. The newly extracted
action units (which we name “FACS+”) are both physics and
geometry-based, and extend the well-known FACS parameters for facial
expressions by adding temporal information and non-local spatial
patterning of facial motion
View citation and abstract |