A novel gesture-based interface for a VR simulation: Re-discovering Vrouw Maria

In this paper, we present the design and the development of a robust, low-cost and easy to implement system for a gesture-based interface that enables visitors to navigate in 3D in a virtual reality environment. By using a state-of-the-art 3D motion sensing device, Microsoft Kinect, and publicly available gesture recognition technologies, the interface allows visitors to navigate in three dimensions without introducing any kind of physical device like gloves or 3D pointers. In the paper, we describe the system, the tracking technology and the user interface through the case study of Rediscovering Vrouw Maria project. Rediscovering Vrouw Maria is a gesture-based, interactive, virtual reality simulation that enables visitors to explore an underwater cultural heritage site with an intuitive interface based on simple human gestures and actions. As a multi-disciplinary design research project, it has been undertaken by Department of Media in Aalto University School of Arts, Design and Architecture and the Maritime Archeology Unit in the National Board of Antiquities of Finland. Started in 2010, the project resulted in an installation for an upcoming exhibition at the Maritime Museum of Finland in Kotka in April 2012.