A Mobile Gesture Interaction Method for Augmented Reality Games Using Hybrid Filters

In most existing games, the separation of gaming operation and feedback regions results in a lower immersion. Therefore, a mobile gesture interaction method is proposed to unify operation and feedback regions to provide users with more immersive interaction experiences. Specifically, the proposed method (PG) integrates a leap motion (LM) device with a HoloLens (HL) augmented reality (AR) glasses, which provides a natural mobile interaction interface between real bare hands and virtual objects in a real environment. To obtain an accurate mobile interaction between the real bare hand and virtual objects, the PG provides an effective registration method between LM and HL AR glasses. To ensure the accuracy and stability of the gesture data, the Kalman filter (KF) and the particle filter (PF) are applied to estimate the position and the orientation of the hand. The proposed interaction method provides a gaming interaction method similar to real-world interaction in daily life, which significantly improves the immersive experience of games. Game experiments and user subjective experience analysis are performed to evaluate the effectiveness of the PG. Results show that the PG yields a better accuracy and provides users with a more immersive interaction experience.