By Topic

Towards a numerically tractable model for the auditory substitution of tactile percepts

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Csapo, A. ; Dept. of Telecommun. & Media Inf., Budapest Univ. of Technol. & Econ., Budapest, Hungary ; Baranyi, P.

We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. A large part of our research deals with how to provide information on tactile percepts - otherwise inaccessible to the remote user - through sound. In this paper, we present one possible mapping between tactile percepts and auditory parameters. Through a set of controlled experiments, we show that the parameters used are meaningful and the sounds can at some level be learned by users as a substitute for tactile perception. Analyzing the error statistics of the experiments, we argue that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis. To this end, we convert the analytical descriptions of our sounds into an higher-order singular value decomposition (HOSVD) based tensor product model form. In order to be able to apply a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into such canonical forms.

Published in:

Resilient Control Systems (ISRCS), 2010 3rd International Symposium on

Date of Conference:

10-12 Aug. 2010