CDFi: Cross-Domain Action Recognition Using WiFi Signals

Contactless WiFi based human action recognition exhibits remarkable prospects in the fields such as human-computer interaction and smart home. However, domain dependency restricts its generalization into the real-world deployment. Since it is expensive to label enough new data for retaining a model, it is beneficial to explore few-shot learning for cross-domain sensing with limited target labels. Nevertheless, there are two challenges to be addressed. The first challenge is how to select a suitable dataset from a series of available source domains to prevent negative transfer. The second is to mine action-related characteristics by the feature learning model for the following effective knowledge transfer. In order to tackle the above challenges, we present a cross-domain sensing framework named CDFi, which consists of Nearest Neighbor based Domain Selector (NNDS) and Fine-to-Coarse-Grained Transformer Network (FCGTN). NNDS is proposed to evaluate the source-target domain similarities by measurements among local and global feature distributions. Besides, FCGTN embeds convolution map based hierarchical transformer structures and the modified linear layer into an end-to-end deep network, which can quickly adapt to the unseen domain by few samples. Comprehensive experiments show that CDFi can effectively realize cross-domain action recognition, and achieve about 4% and 10% improvement on cross-user and cross-scene cases, respectively, compared to the state-of-the-art.