THear: Development of a mobile multimodal audiometry application on a cross-platform framework

This paper presents our ongoing research in the field of audiometry application development. There are many researches on the development of audiometry application but they are all platform specific. In this paper, we developed a new multimodal framework that enabled cross-platform development by using open standards such as HTML5, CSS5 and JavaScript. We will describe the architecture of the new multimodal framework which supports the conduction of the automatic audiometry. Based on the framework, we further propose three multimodal speech audiometry approaches for supporting automatic speech audiometry on mobile devices. By using the framework combined with the three multimodal speech audiometry approaches, we developed an application called THear (TsingHua ear) to support the conduction of pure-tone audiometry and speech audiometry on mobile devices. A preliminary performance evaluation on THear will also be reported.