3D Natural Interaction for an Augmented Reality System

3D natural interaction is one of the topics actively investigated, by both researchers and developers, in order to provide more systems allowing users to interact with the 3D contents in an easy and an intuitive manner by using natural body inputs. In this work, we present an augmented reality system in which the user can interact naturally using the voice to select and manipulate 3D objects. Two ways are used to integrate vocal commands in the system (i) using the Speech Recognition API (Windows) as an offline solution (ii) using Speech Services (IBM Watson) as on the cloud solution. Furthermore, we show our application meant to teach the DNA molecule's 3D form, this application is capable of visualizing the whole molecule as well as its different components, it provides the user by multiple annotations to enhance their information and knowledge, also several voice commands can be used by pronouncing either simple words or longer phrases in a natural way.