A Speech Based Approach to Surveillance Video Retrieval

This paper describes the anatomy of a pilot surveillance system with a speech-based interface for content-based retrieval of video data. The proposed system relies on an ontology-based information sharing architecture and lets components of the system communicate among each other through TCP/IP communication channels. The aim of developing the pilot system was to explore dependencies between image analysis, event detection, video annotation, and speech- based retrieval of the video content in the context of a broader spoken dialogue system.