Generative Neural Networks for Anomaly Detection in Crowded Scenes

Security surveillance is critical to social harmony and people's peaceful life. It has a great impact on strengthening social stability and life safeguarding. Detecting anomaly timely, effectively and efficiently in video surveillance remains challenging. This paper proposes a new approach, called S
²
-VAE, for anomaly detection from video data. The S
²
-VAE consists of two proposed neural networks: a Stacked Fully Connected Variational AutoEncoder (S
_F
-VAE) and a Skip Convolutional VAE (S
_C
-VAE). The S
_F
-VAE is a shallow generative network to obtain a model like Gaussian mixture to fit the distribution of the actual data. The S
_C
-VAE, as a key component of S
²
-VAE, is a deep generative network to take advantages of CNN, VAE and skip connections. Both S
_F
-VAE and S
_C
-VAE are efficient and effective generative networks and they can achieve better performance for detecting both local abnormal events and global abnormal events. The proposed S
²
-VAE is evaluated using four public datasets. The experimental results show that the S
²
-VAE outperforms the state-of-the-art algorithms. The code is available publicly at https://github.com/tianwangbuaa/.