By Topic

User-driven recognition of audio events in news videos

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Giannakopoulos, T. ; Inst. of Inf. & Telecommun., Comput. Intell. Lab., Nat. Center for Sci. Res. Demokritos, Greece ; Petridis, S. ; Perantonis, S.

We propose a method for user-driven recognition of events in audio streams, aiming to assist journalists towards easily annotate unedited audiovisual content. Nonlocal information provided by the user, as for example that the sound of applause exists within the video, is used for adapting the audio event classifiers so as to detect the exact position of these events in the video. Towards this end, each audio class is modeled using a Support Vector Machine (SVM) and the final automatic decision is taken on a mid-term audio basis, using an alternative of the One Vs All architecture. A weighting function is generated based on the user input and it is applied on the soft-output decision of the respective SVMs, thus adapting the final decision to the user's provided knowledge. To evaluate our method, we have used a large dataset of real news videos, provided by the German international broadcaster (DW - Deutsche Welle) and the Portugese broadcaster (Lusa - Agłncia de Notcias de Portuga) where five audio classes, often met in the particular dataset, are defined. Results show that the above process leads to significant raise of the audio tracking performance.

Published in:

Semantic Media Adaptation and Personalization (SMAP), 2010 5th International Workshop on

Date of Conference:

9-10 Dec. 2010