By Topic

Towards building a better language model for SWITCHBOARD: the POS tagging task

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
Hamaker, J.S. ; Dept. of Comput. Sci., Mississippi State Univ., MS, USA

Language models are used extensively in state-of-the-art speech recognition systems to help determine the probability of a hypothesized word sequence. These probabilities, along with the acoustic model scores, allow the system to constrain the search space during recognition to only those word sequences that have a reasonable chance of being correct. In order to determine these probabilities, knowledge of the entire problem space is necessary. However, in speech recognition, this is an unreasonable if not impossible task, especially when one is using the SWITCHBOARD corpus (a large corpus consisting of over 240 hours of recorded telephone conversations totaling almost 3 million words of text). Many statistical and rule-based approaches have been applied to this problem in order to arrive at a language model that produces the minimal word error rate (WER) of the recognizer. One technique includes part-of-speech (POS) information in the language model. This paper discusses the task of tagging the SWITCHBOARD corpus with POS information in the usual manner, and the problems encountered when trying to conform conversational speech to these tags

Published in:

Information Intelligence and Systems, 1999. Proceedings. 1999 International Conference on

Date of Conference:

1999