Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains
Leonardi, R.
Migliorati, P.
Prandini, M.
Dept. of Electron. for Autom., Univ. of Brescia, Italy;
This paper appears in: Circuits and Systems for Video Technology, IEEE Transactions on
Publication Date: May 2004
Volume: 14,
Issue: 5
On page(s): 634- 643
ISSN: 1051-8215
INSPEC Accession Number: 7968866
Digital Object Identifier: 10.1109/TCSVT.2004.826751
Current Version Published: 2004-05-04
Abstract
Content characterization of sport videos is a subject of great interest to researchers working on the analysis of multimedia documents. In this paper, we propose a semantic indexing algorithm which uses both audio and visual information for salient event detection in soccer. The video signal is processed first by extracting low-level visual descriptors directly from an MPEG-2 bit stream. It is assumed that any instance of an event of interest typically affects two consecutive shots and is characterized by a different temporal evolution of the visual descriptors in the two shots. This motivates the introduction of a controlled Markov chain to describe such evolution during an event of interest, with the control input modeling the occurrence of a shot transition. After adequately training different controlled Markov chain models, a list of video segments can be extracted to represent a specific event of interest using the maximum likelihood criterion. To reduce the presence of false alarms, low-level audio descriptors are processed to order the candidate video segments in the list so that those associated to the event of interest are likely to be found in the very first positions. We focus in particular on goal detection, which represents a key event in a soccer game, using camera motion information as a visual cue and the "loudness" as an audio descriptor. The experimental results show the effectiveness of the proposed multimodal approach.
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
