Research On Aircraft Virtual Assembly Technology Based On Gesture Recognition

With the continuous development of computer, virtual simulation and human-computer interaction technology, virtual reality technology has been continuously improved and matured. Especially in recent years, with the intelligentization of mobile phones and the birth of VR glasses and helmets, the research of virtual reality technology has formed in various industries around the world. VR technology has much lower cost and difficulty in creating virtual scenes than building real world.. This article selects HTC Vive pro kit and Leap Motion as the hardware platform, and uses Unity3D and related plug-ins and Leap Motion plug-in as the software platform to develop a set of aircraft virtual equipment maintenance system based on gesture recognition. In the process of gesture recognition, the theory of machine learning was introduced to model, train and identify the gesture information collected by Leap Motion sensor. It can be equipped with the correct virtual tool in the virtual scene to complete the assembly of the corresponding components, and has a good sense of immersion.