Multi-Band Wi-Fi Sensing With Matched Feature Granularity

Complementary to the fine-grained channel state information (CSI) and coarse-grained received signal strength indicator (RSSI) measurements, the mid-grained spatial beam attributes [i.e., beam SNR (bSNR)] during the millimeter-wave (mmWave) beam training phase were recently repurposed for Wi-Fi sensing applications, such as human activity recognition and indoor localization. This article proposes a multiband Wi-Fi sensing framework to fuse features from both CSI from 5-GHz bands and the mid-grained bSNR at 60 GHz with feature granularity matching (GM) that pairs feature maps from the CSI and bSNR at different granularity levels with learnable weights. To address the issue of limited labeled training data, we propose to pretrain an autoencoder-based multiband Wi-Fi fusion network in an unsupervised fashion. For specific sensing tasks, separate sensing heads can be attached to the pretrained fusion network with fine-tuning. The proposed framework is thoroughly validated for three sensing applications using in-house experimental data sets: 1) pose recognition; 2) occupancy sensing; and 3) indoor localization. Comparison to a list of baseline methods demonstrates the effectiveness of GM. An ablation study is performed as a function of the amount of labeled data, the latent space dimension, and learning rates.