Audio-visual interaction in multimodal communication

Multimedia signal processing is more than simply "putting together" text, audio, images, and video. It is the integration and interaction among these different media that creates new systems and new research challenges and opportunities. In multimodal communication where speech is involved, audio-visual interaction is particularly significant.