Spatiotemporal visual attention architecture for video analysis

Several visual attention (VA) schemes have been proposed with the saliency-based ones being the most popular. The proposed work provides an extension towards VA in video sequences by incorporating the temporal dimension. The architecture is presented in detail and potential applications are investigated. We expect that the extended VA scheme can reveal interesting events across the sequence like occlusions and short occurrences of objects, providing a basis for video surveillance (e.g. intruder detection), segmentation, and summarization applications.