Data-driven augmented reality display and operations for UAV ground stations

The commonly used 2D Display is limited in aiding operators to control unmanned aerial vehicles (UAVs) within complex environments, due to its weak immersion. This paper proposes a data-driven 3D augmented reality approach. Pre-known data and experience can be integrated into to constructing a 3D virtual scenario. Furthermore, the on-board sensor data is continuously updated to this scenario during the task process. Under such circumstance, the static scenario and dynamic data are fused together by using the UAV's position and orientation. Task-associated information, e.g. route points and flying status, is simultaneously imported into the scenario to augment the virtual reality and to support the operator as well. Eventually, the AR ground station prototype is designed and implemented. Experimental results of quad rotors demonstrate that the developed system is feasible and effective to strengthen immersion with the virtual reality glasses.