An Efficient Token Mixer Model for Sheet Metal Defect Detection

Defects such as scratches, patches, and cracks frequently occur during sheet metal production. However, the low detection accuracy and slow processing speed of industrial defect detection models significantly impede enterprise production efficiency. The aforementioned issues primarily manifest in three aspects. Firstly, the model complexity and computational overhead are substantial. Secondly, detecting small local defects poses a significant challenge. Thirdly, extracting global features, such as elongated scratches, proves to be difficult. To address these challenges, this paper introduces a novel network architecture called SATRNet. Firstly, within the model backbone, the STR module is devised. Through incorporation of the sparse self-attention method and the CNNs parallel vision Transformer model in the shallow layers, this module significantly enhances the model's capability to extract global features. Secondly, the SCATR module is designed in this paper. By substituting self-attention with the designed SCA soft attention as the token mixer, the module aims to enhance detection accuracy while reducing the number of parameters, thereby fundamentally addressing the problem of model complexity. Finally, this paper presents the GCD bottleneck convolution module. This module combines shallow and deep features, enabling the fusion of more information beneficial for detection, thereby achieving improved efficacy in capturing minute targets. Experiments demonstrate that SATRNet surpasses existing advanced models in detection accuracy on public datasets.