VoxAR: 3D Modelling Editor Using Real Hands Gesture for Augmented Reality

Augmented Reality (AR) is a technology where it supports both real and virtual content in a single view which merges virtual objects and real world in real-time in a single display view. Interaction in AR allows the user to interact with the virtual images using real objects. The remaining issues need to be improved are the occlusion problems when interacting with virtual object using both hands for AR environment. However, it is crucial to bring Three-Dimensional (3D) modelling approach in AR where user can modify the virtual objects using their real hands. Therefore, this study aims to develop a prototype for 3D modelling editor in AR by using real hands gestures. The 3D modelling editor using real hands gesture running in real-time which capture user's hands to modify 3D object and model an object using voxel-based modelling technique. Voxel-based is a 2D pixel-like 3-dimensional element. An object is represented in volumetric modelling as a collection of 3D arrangement voxels that may be regular or irregular. The evaluation was conducted to evaluate users experience when they interact with the virtual objects using hands gesture in AR 3D modelling editor prototype called VoxAR which provide the basic features such as colour picker, draw voxel, erase voxel and select voxel. This project is significant to produce intuitive 3D hands gesture interaction in AR environment.