Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study With Broadcast News
Hauptmann, A.
Rong Yan
Wei-Hao Lin
Christel, M.
Wactlar, H.
Carnegie Mellon Univ., Pittsburgh;
This paper appears in: Multimedia, IEEE Transactions on
Publication Date: Aug. 2007
Volume: 9,
Issue: 5
On page(s): 958-966
ISSN: 1520-9210
INSPEC Accession Number: 9606823
Digital Object Identifier: 10.1109/TMM.2007.900150
Current Version Published: 2007-07-23
Abstract
A number of researchers have been building high-level semantic concept detectors such as outdoors, face, building, to help with semantic video retrieval. Our goal is to examine how many concepts would be needed, and how they should be selected and used. Simulating performance of video retrieval under different assumptions of concept detection accuracy, we find that good retrieval can be achieved even when detection accuracy is low, if sufficiently many concepts are combined. We also derive suggestions regarding the types of concepts that would be most helpful for a large concept lexicon. Since our user study finds that people cannot predict which concepts will help their query, we also suggest ways to find the best concepts to use. Ultimately, this paper concludes that "concept-based" video retrieval with fewer than 5000 concepts, detected with a minimal accuracy of 10% mean average precision is likely to provide high accuracy results in broadcast news retrieval.
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
