Automatic synthesis of background music track data by analysis of video contents

This paper describes an automatic creation technique of background music track data for a given video file. Our proposed system is based on a novel BGM synthesizer, called "Matrix Music Player", which can produce 3125 kinds of high-quality BGM contents by dynamically mixing 5 audio files, which are freely selected from a total of 25 audio waveform files. In order to retrieve appropriate BGM mixing patterns, we have constructed an acoustic analysis database, which records acoustic features of a total of 3125 synthesized patterns. Developing a video analyzer which generates image parameters of given video data and converts them to acoustic parameters, we access the acoustic analysis database and retrieve an appropriate synthesized BGM signal, which can be included in the audio track of the source video file.