Active video-based surveillance system: the low-level image and video processing techniques needed for implementation

The importance of video surveillance techniques has considerably increased since the latest terrorist incidents. Safety and security have become critical in many public areas, and there is a specific need to enable human operators to remotely monitor the activity across large environments. For these reasons, multicamera systems are needed to provide surveillance coverage across a wide area, ensuring object visibility over a large range of depths. In the development of advanced visual-based surveillance systems, a number of key issues critical to its successful operation must be addressed. This article describes the low-level image and video processing techniques needed to implement a modern surveillance system. In particular, the change detection methods for both fixed and mobile cameras (pan and tilt) are introduced and the registration methods for multicamera systems with overlapping and nonoverlapping views are discussed.