Extensible video surveillance software with simultaneous event detection for low and high density crowd analysis

Manual analysis of large volumes of video surveillance footage stemming from the widespread deployment of security cameras is error prone, expensive and time consuming. Despite the commercial availability of software for automated analysis, many products lack third party extensibility, the capability to perform simultaneous event detection and have no provision for anomaly detection in highly dense crowded scenes. We present a plugin based software system for video surveillance applications addressing these shortcomings and achieve realtime performance in typical crowded scenes. Core parameters are computed once per frame and shared among plugins to improve performance by eliminating redundant calculations. A novel multiple pedestrian tracking algorithm is incorporated into the framework to achieve the expected performance. We also propose an improvement to anomaly detection in densely crowded scenes using non-trajectory based dominant motion pattern clusters that can enhance the detection capability of the state-of-the-art.