Generalizing Wireless Cross-Multiple-Factor Gesture Recognition to Unseen Domains

Cross-domain wireless sensing has always been challenging due to the sensitivity of wireless signals to various environmental factors, which we refer to as subdomains. However, current efforts are limited to cross-one-subdomain tasks requiring target domain data for model training or multiple receivers for data collection. Taking common gesture recognition as an application example, we attempt to demonstrate the feasibility of cross-multiple-subdomain wireless sensing in the more challenging domain generalization (DG) setting. It is possible to extract domain-invariant features from one or several source domain(s), thereby avoiding the need for multiple receivers or target domain data. We also propose an intelligent wireless data augmentation technique based on subdomain-guided perturbations, named WiSGP. Specifically, the independent domain model generates perturbations in the direction of the largest subdomain variations. Then, these subdomain-guided perturbations augment the gesture model's input to enable better domain-invariant feature extraction, even when various subdomains interact. Similarly, gesture-guided perturbations augment the domain model's input, resulting in more accurate subdomain-guided perturbations and minimal gesture label changes. Extensive experiments have been conducted on three datasets collected from various NICs. In terms of room, location, orientation, and user subdomains, WiSGP exhibits excellent accuracy, generalizability, and portability for both cross-one-subdomain and cross-multiple-subdomain tasks.