Automatic Overlaid Text Detection, Extraction and Recognition for High Level Event/Concept Identification in Soccer Videos

Overlaid text appears frequently in broadcast sports video. They provide supplementary information regarding the happenings of a particular game. Examples include important events of interest such as bookings and substitutions in a soccer match. Furthermore, overlaid-text is displayed when a particular concept of interest is happening or has happened. This paper presents a technique to automatically detect only video frames that contain valid overlaid text. Experiments have shown reliable detection, extraction and recognition, whose results have been successfully used for domain concept understanding via matching with a soccer term database.