Depth — Melody substitution

We present a system for visuo-auditory substitution that takes as input a depth map, and produces as output a corresponding melody. A real-time apparatus based on the Kinect
^®
, a computer and a headphone, is developed within our team. Earlier experiment with the system shows that, when equipped, a sighted person temporary deprived from vision can therefore move in an unknown indoor environment without any training.