Semantic audiovisual analysis for video summarization
Junyong You
Hannuksela, M.M.
Gabbouj, M.
This paper appears in: EUROCON 2009, EUROCON '09. IEEE
Publication Date: 18-23 May 2009
On page(s): 1358-1363
Location: St.-Petersburg,
ISBN: 978-1-4244-3860-0
INSPEC Accession Number: 10791309
Digital Object Identifier: 10.1109/EURCON.2009.5167816
Posted online: 2009-07-21 13:19:42.0
Abstract
This paper proposes a semantic audiovisual analysis approach for video summarization. The sequence to be analyzed is first segmented into scenes according to audio similarity. Some global clues such as loudness, the ratio of unrelated shots, and the affective relationship between the scenes and the whole sequence are employed to compute the semantic scene importance. The shots in each scene are grouped based on the luminance histograms, and the semantic shot importance is then calculated using selected audio and video features. Subsequently, key frames are extracted according to the semantic frame importance computed based on certain visual features, such as attention region and motion information. This approach is effective to generate a representative video summary whilst avoiding some disadvantages of the traditional video summarization methods. Experimental results demonstrate promising performance of the proposed approach.
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
