Loading [MathJax]/extensions/MathZoom.js
Low-dimensional motion features for audio-visual speech recognition | IEEE Conference Publication | IEEE Xplore

Low-dimensional motion features for audio-visual speech recognition


Abstract:

Audio-visual speech recognition promises to improve the performance of speech recognizers, especially when the audio is corrupted, by adding information from the visual m...Show More

Abstract:

Audio-visual speech recognition promises to improve the performance of speech recognizers, especially when the audio is corrupted, by adding information from the visual modality, more specifically, from the video of the speaker. However, the number of visual features that are added is typically bigger than the number of audio features, for a small gain in accuracy. We present a method that shows gains in performance comparable to the commonly-used DCT features, while employing a much smaller number of visual features based on the motion of the speaker's mouth. Motion vector differences are used to compensate for errors in the mouth tracking. This leads to a good performance even with as few as 3 features. The advantage of low-dimensional features is that a good accuracy can be obtained with relatively little training data, while also increasing the speed of both training and testing.
Date of Conference: 03-07 September 2007
Date Added to IEEE Xplore: 04 May 2015
Print ISBN:978-839-2134-04-6
Conference Location: Poznan, Poland

References

References is not available for this document.