Interactive audio-visual performance system controlled by smartphone based on arm movements

This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.