By Topic

3D Visible Speech Animation Driven by Chinese Prosody Markup Language

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Siguang Zhang ; Coll. of Comput. Sci., Beijing Univ. of Technol., Beijing ; Lichun Wang ; Hengliang Tang

This paper proposes a new approach for generating smart 3D speech animation. The basic idea is to synthesize the animated faces using prosodic information edited by user with a kind of markup language. The proposed technique takes advantage of both performance-driven and parameter-driven approaches. So it greatly reduces the workload of manual modeling used in the traditional key frame animation and the animation generating process can be easily control. To relate the prosody text with the 3D animation, our technique builds up a parametric model based on the exponential formula. It takes the pre-obtained 3D dynamic visemes and prosodic tag recorded in CPML (Chinese Prosody Markup Language) as input data, and outputs a segment of vivid speech animation. Experimental results show that (1) the proposed technique synthesizes animation of different effects depending on the availability with the prosodic information, and (2) the new technique produces realistic results using less data than the conventional methods.

Published in:

Advanced Language Processing and Web Information Technology, 2008. ALPIT '08. International Conference on

Date of Conference:

23-25 July 2008