Structural metadata research in the EARS program
Yang Liu; Shriberg, E.; Stolcke, A.; Peskin, B.; Ang, J.; Hillard, D.; Ostendorf, M.; Tomalin, M.; Woodland, P.; Harper, M.
Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP apos;05). IEEE International Conference on
Volume 5, Issue , 18-23 March 2005 Page(s): v/957 - v/960 Vol. 5
Digital Object Identifier 10.1109/ICASSP.2005.1416464
Summary: Both human and automatic processing of speech require recognition of more than just words. In this paper we provide a brief overview of research on structural metadata extraction in the DARPA EARS rich transcription program. Tasks include detection of sentence boundaries, filler words, and disfluencies. Modeling approaches combine lexical, prosodic, and syntactic information, using various modeling techniques for knowledge source integration. The performance of these methods is evaluated by task, by data source (broadcast news versus spontaneous telephone conversations) and by whether transcriptions come from humans or from an (errorful) automatic speech recognizer. A representative sample of results shows that combining multiple knowledge sources (words, prosody, syntactic information) is helpful, that prosody is more helpful for news speech than for conversational speech, that word errors significantly impact performance, and that discriminative models generally provide benefit over maximum likelihood models. Important remaining issues, both technical and programmatic, are also discussed.
View citation and abstract |