Noisy text categorization
- Already Purchased? View Article
- Subscription Options Learn More
This work presents categorization experiments performed over noisy texts. By noisy, we mean any text obtained through an extraction process (affected by errors) from media other than digital texts (e.g., transcriptions of speech recordings extracted with a recognition system). The performance of a categorization system over the clean and noisy (word error rate between ∼ 10 and ∼ 50 percent) versions of the same documents is compared. The noisy texts are obtained through handwriting recognition and simulation of optical character recognition. The results show that the performance loss is acceptable for recall values up to 60-70 percent depending on the noise sources. New measures of the extraction process performance, allowing a better explanation of the categorization results, are proposed.
Published in:
Pattern Analysis and Machine Intelligence, IEEE Transactions on
(Volume:27
,
Issue:
12
)
Date of Publication: Dec. 2005