Dual-User Virtual Mouse System Using Acoustic-Based Hand Tracking

Acoustic-based hand tracking has garnered significant attention in the field of Human-Computer Interaction (HCI) due to its cost-effectiveness and ease of implementation. However, a critical limitation of existing approaches is their inability to accommodate multiple users, restricting their utility in scenarios such as multi player gaming. In this paper, a prototype equipped with standalone speakers and microphones offers precise hand tracking and mouse cursor control. Notably, it supports two users to operate independently. For each user, a dedicated set of one speaker and two microphones are employed. To enable the participation of a second user, an additional speaker and two supplementary microphones were positioned in the opposite direction. To minimize the interference between users, distinct frequencies of sinusoidal waves and Zadoff-Chu (ZC) signals generated by the co-prime root indexes were allocated for each user. The proposed method demonstrates remarkable performance, achieving an average hand tracking error of 5.7 mm.