Abstract:
Finger microgestures have been widely used in human computer interaction (HCI), particularly for interactive applications, such as virtual reality (VR) and augmented real...Show MoreMetadata
Abstract:
Finger microgestures have been widely used in human computer interaction (HCI), particularly for interactive applications, such as virtual reality (VR) and augmented reality (AR) technologies, to provide immersive experience. However, traditional 2D image-based microgesture recognition suffers from low accuracy due to the limitations of 2D imaging sensors, which have no depth information. In this article, we proposed an innovative 3D microgesture recognition system based on a holoscopic 3D imaging sensor. Due to the lack of holoscopic 3D datasets, a comprehensive holoscopic 3D microgesture (HoMG) database is created and used to develop a robust 3D microgesture recognition method. Then, a fast algorithm is proposed to extract multiviewpoint images from one holoscopic image. Furthermore, we applied a CNN model with an attention-based residual block to each viewpoint image to improve the algorithm performance. Finally, bagging classification tree decision-level fusion is applied to combine the predictions. The experimental results demonstrate that the proposed method outperforms state-of-the-art methods and delivers a better accuracy than existing methods.
Published in: IEEE Transactions on Human-Machine Systems ( Volume: 51, Issue: 2, April 2021)
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Neural Network ,
- Deep Network ,
- Deep Neural Network ,
- Decision Fusion ,
- Viewpoint Images ,
- Interactive ,
- Convolutional Neural Network ,
- 3D Images ,
- 2D Images ,
- Human-computer Interaction ,
- Convolutional Neural Network Model ,
- Residual Block ,
- Augmented Reality Technology ,
- Decision-level Fusion ,
- Straight Line ,
- Feature Maps ,
- Image Dataset ,
- Internet Of Things ,
- Convolution Kernel ,
- Subset Of Images ,
- Hand Gesture Recognition ,
- American Sign Language ,
- 3D Information ,
- 3D Scene ,
- Fusion Method ,
- Voting Method ,
- Microlenses ,
- Microlens Array ,
- Sign Language
- Author Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Neural Network ,
- Deep Network ,
- Deep Neural Network ,
- Decision Fusion ,
- Viewpoint Images ,
- Interactive ,
- Convolutional Neural Network ,
- 3D Images ,
- 2D Images ,
- Human-computer Interaction ,
- Convolutional Neural Network Model ,
- Residual Block ,
- Augmented Reality Technology ,
- Decision-level Fusion ,
- Straight Line ,
- Feature Maps ,
- Image Dataset ,
- Internet Of Things ,
- Convolution Kernel ,
- Subset Of Images ,
- Hand Gesture Recognition ,
- American Sign Language ,
- 3D Information ,
- 3D Scene ,
- Fusion Method ,
- Voting Method ,
- Microlenses ,
- Microlens Array ,
- Sign Language
- Author Keywords