Video Foreground Segmentation Based on Sequential Feature Clustering
Mei Han
Wei Xu
Yihong Gong
NEC Labs. America, Cupertino, CA;
This paper appears in: Pattern Recognition, 2006. ICPR 2006. 18th International Conference on
Publication Date: 0-0 0
Volume: 1,
On page(s): 492-496
Location: Hong Kong,
ISSN: 1051-4651
ISBN: 0-7695-2521-0
INSPEC Accession Number: 9209816
Digital Object Identifier: 10.1109/ICPR.2006.1170
Current Version Published: 2006-09-18
Abstract
Segmentation of videos into layers of foreground objects and background has many important applications, such as video compression, human computer interaction, and motion analysis. Most existing methods work on image pixels or color segmentations which are computation expensive. Some methods require extensive manual input, static cameras, and/or rigid scenes. In this paper we propose a fully automatic segmentation method based on sequential clustering of sparse image features. The sparseness makes the method computation efficient. We use both edge and corner features to capture the outline of the foreground objects. Sequential linear regression is applied to the movement sequences of image features in order to compute the motion parameters for foreground objects and background layers, and consider the temporal smoothness simultaneously. Foreground layer is then extracted by a pyramidal Markov random field (MRF) model taking into account the spatial smoothness constraint. Experimental results on videos taken by webcams are shown and discussed
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.