By Topic

From Landscape to Soundscape

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Philippe Codognet ; Inf. Technol. Center, JFLI, Univ. of Tokyo, Tokyo, Japan ; Gilbert Nouno

We present a multi-contextual interactive project which aims to create an open and real-time musical environment extending a natural ambient environment, namely an urban landscape. The basic idea is to convert in real-time the input from a camera sensor recording a urban landscape (in our first test-case: Tokyo city at night) into an electronic musical soundscape. This is achieved by considering each blinking light as a rhythm source (or to combine several lights into a single source in order to have more complex rhythmic structures), to associate it to some sound from a sound bank and possibly to add some sound effects. This will thus generate many layers of intertwined rhythms that represent the pulse of the city through its blinking lights. Therefore this project encompass artistic creation process embedding image tracking, artificial intelligence with inductive original tempo tracking and beat prediction algorithms. We perform pertinent image and symbolic descriptors extractions, as pulsation and rhythm features, in order to synchronize both musical and control worlds with the natural visual environment. The key idea is to achieve an emergent rhythmic process for musical creation and generative music.

Published in:

Virtual Systems and Multimedia, 2009. VSMM '09. 15th International Conference on

Date of Conference:

9-12 Sept. 2009