Advancing Human-Computer Interaction: Smartphone-Integrated POF Speckle Sensor for Gesture and Identity Recognition

Human-computer interaction (HCI) is rapidly advancing, particularly with the integration of gesture recognition with intelligent technology. Moreover, enhanced personalization and security are offered by combining gesture recognition with identity recognition for HCI. An advanced pulse sensing system is proposed via a smartphone-integrated plastic optical fiber (POF) speckle sensor and neural networks for gesture and identity recognition. Simultaneously, an evaluation is carried out to explore the impact of different diameters of POF and diverse image processing algorithms on the system’s performance. The average SNR (11.64 dB) and measurement error (0.37%) are exhibited by the system. The system demonstrates accuracies of 91% for gesture recognition and 87% for identity recognition. These results underscore the system’s effectiveness in signal quality, versatility, and recognition tasks, highlighting its potential for enhancing HCI and security applications.