Automated Music Video Generation using WEB Image Resource
Rui Cai
Lei Zhang
Feng Jing
Wei Lai
Wei-Ying Ma
Microsoft Res. Asia, Beijing;
This paper appears in: Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on
Publication Date: 15-20 April 2007
Volume: 2,
On page(s): II-737-II-740
Location: Honolulu, HI,
ISSN: 1520-6149
ISBN: 1-4244-0727-3
INSPEC Accession Number: 9497221
Digital Object Identifier: 10.1109/ICASSP.2007.366341
Current Version Published: 2007-06-04
Abstract
In this paper, we proposed a novel prototype of automated music video generation using Web image resource. In this prototype, the salient words/phrases of a song's lyrics are first automatically extracted and then used as queries to retrieve related high-quality images from Web search engines. To guarantee the coherence among the chosen images' visual representation and the music song, the returned images are further re-ranked and filtered based on their content characteristics such as color, face, landscape, as well as the song's mood type. Finally, those selected images are concatenated to generate a music video using the Photo2Video technique, based on the rhythm information of the music. Preliminary evaluations of the proposed prototype have shown promising results
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.