Interactive recovery from speech recognition errors in speech user interfaces

The authors present a multimodal approach to interactive recovery from speech recognition errors for the design of speech user interfaces. They propose a framework to compare various error recovery methods, arguing that a rational user will prefer interaction methods which provide an optimal trade off between accuracy, speed and naturalness. They describe a prototypical implementation of multimodal interactive error recovery and present results from a preliminary evaluation in form filling and speech to speech translation tasks.