Lip movement synthesis in audio-visual speech recognition system

This paper describes a technique for synthesizing audio-visual speech based on HMM. The experiment "Lip movement synthesis" use VC++ and HTK toolkit. In the training stage, Japanese words will be change to text from the image sequence from using hidden Markov model (HMM). Experimental results show that the synthetic lip image sequence is smooth and realistic. This research was supported by NSFC, China (Grant No.60374032).