Mobiature: 3D model manipulation technique for large displays using mobile devices

This paper presents Mobiature (mobile miniature), a 3D model manipulation technique for large displays in which mobile devices are used as multimodal controllers. The technique enables the performance of 3D manipulation tasks such as rotation of a 3D model and selection of a particular part of the model. For performing these tasks, we develop a new method to capture the orientation of a mobile device from motion sensor data along with a new noise reduction scheme. The results of our informal usability test reveal that (a) users perceive Mobiature to be an intuitive technique that allows them to perform 3D model manipulation tasks in a convenient manner and (b) using Mobiature is an entertaining experience in itself for the users. This technique can be employed in various applications such as large display appliances (e.g., digital signages, TVs, digital window displays, etc.) and mobile devices (e.g., smartphones, PDAs, etc.) without any additional hardware modifications. Potential fields of application include advertising, entertainment, and information broadcasting.