Automated lip synchronized speech driven facial animation
Melek, Z.
Akarun, L.
Dept. of Comput. Eng., Bogazici Univ., Istanbul ;
This paper appears in: Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on
Publication Date: 2000
Volume: 2,
On page(s): 623-626 vol.2
Meeting Date: 07/30/2000 - 08/02/2000
Location: New York, NY, USA
ISBN: 0-7803-6536-4
References Cited: 20
INSPEC Accession Number: 6704161
Digital Object Identifier: 10.1109/ICME.2000.871440
Current Version Published: 2002-08-06
Abstract
Talking 3D synthetic faces are now used in many applications
involving human-computer interaction. The lip synchronization of the
faces are mostly done mechanically by computer animators. Although there
is some work done on automated lip synchronized facial animation, these
studies are mostly based on text input. We use speech in Turkish as an
input to generate lip synchronized facial animation. Speakers' recorded
voice is converted into lip shape classes on the 3D model. Voice is
analyzed and classified using a training set. Lip animation is
facilitated using facial muscles and the jaw. Facial muscles are
modelled onto our facial model. For more realistic facial animation,
facial tissue is modelled as well, and the interactions between
epidermis, subcutaneous layer and bone are taken into account.
Natural-looking facial animation is achieved in real-time on a personal
computer. We also show that our system is compatible with MPEG4
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
