Fuzzy Inference Attention Module for Unsupervised Domain Adaptation

Unsupervised domain adaptation (UDA) aims to transfer knowledge acquired from the labeled source domain to the unlabeled target domain. However, the quality of samples can vary greatly. While partial samples are dominated by high-quality domain-invariant class-related information, others may only contain irrelevant domain-specific information or useless random noise. Treating all samples equally may lead to negative transfer, significantly impairing the performance. To address the issue of varying sample quality, we propose an attention module to emphasize the samples that are most suitable for transfer. Within the attention module, we have designed a fuzzy inference system to assess the quality of data based on its class and domain information. Such a fuzzy inference attention (FIA) module demonstrates strong interpretability due to its consideration of the fuzzy nature inherent in class and domain information within the data. FIA also has high flexibility and extensibility as the rule base can be easily adjusted by expert knowledge. More importantly, FIA does not use any parameters requiring training and has a low overhead. This makes it fast and applicable to most existing UDA methods. The experiments on several benchmark datasets prove that FIA can bring significant improvement to existing methods.