D3PointNet: Dual-Level Defect Detection PointNet for Solder Paste Printer in Surface Mount Technology

In the field of surface mount technology (SMT), early detection of defects in production machines is crucial to prevent yield reduction. In order to detect defects in the production machine without attaching additional costly sensors, attempts have been made to classify defects in solder paste printers using defective solder paste pattern (DSPP) images automatically obtained through solder paste inspection (SPI). However, since the DSPP images are sparse, have various sizes, and are hardly collected, existing CNN-based classifiers tend to fail to generalize and over-fitted to the train set. Besides, existing studies employing only multi-label classifiers are less helpful since when two or more defects are observed in the DSPP image, the location of each defect can not be specified. To solve these problems, we propose a dual-level defect detection PointNet (D
³
PointNet), which extracts point cloud features from DSPP images and then performs the defect detection in two semantic levels: a micro-level and a macro-level. In the micro-level, a type of printer defect per point is identified through segmentation. In the macro-level, all types of printer defects appearing in a DSPP image are identified by multi-label classification. Experimental results show that the proposed D
³
PointNet is robust to the sparsity and size changes of the DSPP image, and its exact match score was 10.2% higher than that of the existing CNN-based state-of-the-art multi-label classification model in the DSPP image dataset.