A computer music system that follows a human conductor

An electronic orchestra with a complex performance database and MIDI (Musical Instrument Digital Interface) controllers is presented. This system responds to the gestures of a conductor through a CCD camera and a sensor glove. The processing of musical information is examined, and the system and its operation are described. It consists of a gesticulation system and the MIDI controllers. The human interface is also discussed. The first professional conductor who tried the system could direct it without special skills or knowledge of either MIDI or a computer. Tests revealed feedback effects on the behavior of the users through their auditory sense, which in turn suggested some ways to determine the parameters of tempo prediction and compensation. The system can play in concert with human performers and even as a part of a symphony orchestra.<
>