Loading [MathJax]/extensions/MathMenu.js
Computational Audiovisual Scene Analysis in Online Adaptation of Audio-Motor Maps | IEEE Journals & Magazine | IEEE Xplore

Computational Audiovisual Scene Analysis in Online Adaptation of Audio-Motor Maps


Abstract:

For sound localization, the binaural auditory system of a robot needs audio-motor maps, which represent the relationship between certain audio features and the position o...Show More

Abstract:

For sound localization, the binaural auditory system of a robot needs audio-motor maps, which represent the relationship between certain audio features and the position of the sound source. This mapping is normally learned during an offline calibration in controlled environments, but we show that using computational audiovisual scene analysis (CAVSA), it can be adapted online in free interaction with a number of a priori unknown speakers. CAVSA enables a robot to understand dynamic dialog scenarios, such as the number and position of speakers, as well as who is the current speaker. Our system does not require specific robot motions and thus can work during other tasks. The performance of online-adapted maps is continuously monitored by computing the difference between online-adapted and offline-calibrated maps and also comparing sound localization results with ground truth data (if available). We show that our approach is more robust in multiperson scenarios than the state of the art in terms of learning progress. We also show that our system is able to bootstrap with a randomized audio-motor map and adapt to hardware modifications that induce a change in audio-motor maps.
Published in: IEEE Transactions on Autonomous Mental Development ( Volume: 5, Issue: 4, December 2013)
Page(s): 273 - 287
Date of Publication: 07 May 2013

ISSN Information:


Contact IEEE to Subscribe

References

References is not available for this document.