By Topic

Census-based vision for auditory depth images and speech navigation of visually impaired users

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Soo-Chang Pei ; Dept. of Electr. Eng., Nat. Taiwan Univ., Taipei, Taiwan ; Yu-Ying Wang

In neuroscience and psychology, visual imagery is the subjective experience of seeing in the absence of visual stimulation. Someone may experience touch or sound as a result of visual imagery. In this paper, a new visual image aid which can provide a different way to visualize the image for visually impaired users is proposed. It is done by applying the depth image to an Image-To-Sound Mapping (ITSM) system. The proposed algorithm utilizes a sparse Census transform (SCT) and color segmentation to obtain an illuminationinvariant depth image. The depth image is applied to the ITSM system and then a clear and simple sound output is obtained for constructing a mental image. Moreover, the reliable three-dimensional (3D) data of close objects are extracted and interpreted as a semantic speech output. Experimental results show that visually impaired users can perceive the image easily and without training by adding verbal description to the visually image aid. In good and poor illuminated environments, the performance is 82% and 80% respectively. The performance of our proposed systems was not influenced by various lighting. All subjects also commented that the systems would be potentially useful1.

Published in:

Consumer Electronics, IEEE Transactions on  (Volume:57 ,  Issue: 4 )