By Topic

Automated control of sound synthesis in live musical performances using modified online time warping

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Gordan Kreković ; Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia ; Davor Petrinović

This paper presents a system for automating sound synthesis parameters during live musical performances. It is a novel practical solution for keyboard players who need to manually control numerous synthesis parameters while playing at the same time. Our idea was to let musicians define how parameters will change through time by inserting automation data into a prerecorded musical piece. During a live performance of the same piece, our system employs a score following algorithm and applies these automation data at the right moments. A referent recording is represented as a MIDI file, whilst a performance is a stream of MIDI events. For the task of score following we implemented the on-line time warping (OLTW) algorithm modified to work with MIDI data. To convert sequential MIDI events into the values at equidistant points in time we employed time framing. As of our knowledge, this is the first usage of OLTW on MIDI representations. We devised a module for applying automation data which includes forward estimation for better time precision. The whole solution was implemented in Java as a real-time system. The evaluation with live performances yielded encouraging results which confirmed the effectiveness of our algorithm and its implementation.

Published in:

ELMAR, 2012 Proceedings

Date of Conference:

12-14 Sept. 2012