Web-based real time content processing and monitoring service for digital TV broadcast

In this paper, we describe a real time content processing and monitoring service for digital TV broadcast. Broadcast monitoring has a wide range of applications, including tracking advertisement air time, detecting inconsistency in electronic program guide, enabling personalized alerting services, maintaining the Quality of Service, etc. Our TV content processing and monitoring system has a modular design, where various real time multimedia content analysis components can be plugged in flexibly. As a proof of concept, we incorporated the following processing modules in the prototype: automatic speech recognition, closed caption extraction, text normalization, keyword extraction, shot boundary detection, face detection and recognition, and near duplicate keyframe detection. These processing components detect a rich set of metadata information, which is collected by the video monitoring server. On a web interface, users can tune to different digital TV channels or pre-recorded video content, and monitor the extracted metadata information as well as watch the video itself.