By Topic

Recognition of separate hand gestures by Time-Delay Neural Networks based on multi-state spectral image patterns from cyclic hand movements

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Paul Modler ; Department of Media Art, University of Media, Arts and Design, Karlsruhe, Germany ; Tony Myatt

In recent years video-basedanalysis of human motion has gained increased interest, which for a large part is due to the ongoing rapid developments of computer and camera hardware, such as increased CPU power, fast and modular interfaces and high-quality image digitisation. A similar important role is played by the development of powerful approaches for the analysis of visual data from video sources. In computer music this development is reflected in a row of applications approaching the analysis of video and image data for gestural control of music and sound, such as Eyesweb, Jitter, openCV, Gem, [1], [2], [3], [4]. In this paper an approach is presented for the control of music and sound parameters through hand gestures, which are recognised through a Time-delay Neural Network (TDNN). The recognition networks were trained with appearance-based features extracted from image sequences of a video camera. Cyclic hand gestures are proposed to enable fast and seamless recording and annotation of time series as multi-state patterns. For the supervised training of the TDNNs feature maps based on spatial Fourier transformation of image sequences are proposed. The integration of the gesture recognition in an interactive music piece will be described at the end of the paper.

Published in:

Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on

Date of Conference:

12-15 Oct. 2008