A Formal Study of Shot Boundary Detection
Jinhui Yuan
Huiyi Wang
Lan Xiao
Wujie Zheng
Jianmin Li
Fuzong Lin
Bo Zhang
Dept. of Comput. Sci. & Eng., Tsinghua Univ., Beijing;
This paper appears in: Circuits and Systems for Video Technology, IEEE Transactions on
Publication Date: Feb. 2007
Volume: 17,
Issue: 2
On page(s): 168-186
ISSN: 1051-8215
INSPEC Accession Number: 9329579
Digital Object Identifier: 10.1109/TCSVT.2006.888023
Current Version Published: 2007-02-05
Abstract
This paper conducts a formal study of the shot boundary detection problem. First, a general formal framework of shot boundary detection techniques is proposed. Three critical techniques, i.e., the representation of visual content, the construction of continuity signal and the classification of continuity values, are identified and formulated in the perspective of pattern recognition. Meanwhile, the major challenges to the framework are identified. Second, a comprehensive review of the existing approaches is conducted. The representative approaches are categorized and compared according to their roles in the formal framework. Based on the comparison of the existing approaches, optimal criteria for each module of the framework are discussed, which will provide practical guide for developing novel methods. Third, with all the above issues considered, we present a unified shot boundary detection system based on graph partition model. Extensive experiments are carried out on the platform of TRECVID. The experiments not only verify the optimal criteria discussed above, but also show that the proposed approach is among the best in the evaluation of TRECVID 2005. Finally, we conclude the paper and present some further discussions on what shot boundary detection can learn from other related fields
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
