Surface defect inspection is of great importance for industrial manufacture
and production. Though defect inspection methods based on deep learning have
made significant progress, there are still some challenges for these methods,
such as indistinguishable weak defects and defect-like interference in the
background. To address these issues, we propose a transformer network with
multi-stage CNN (Convolutional Neural Network) feature injection for surface
defect segmentation, which is a UNet-like structure named CINFormer. CINFormer
presents a simple yet effective feature integration mechanism that injects the
multi-level CNN features of the input image into different stages of the
transformer network in the encoder. This can maintain the merit of CNN
capturing detailed features and that of transformer depressing noises in the
background, which facilitates accurate defect detection. In addition, CINFormer
presents a Top-K self-attention module to focus on tokens with more important
information about the defects, so as to further reduce the impact of the
redundant background. Extensive experiments conducted on the surface defect
datasets DAGM 2007, Magnetic tile, and NEU show that the proposed CINFormer
achieves state-of-the-art performance in defect detection.

通过使用多阶段 CNN 特征注入的 Transformer 网络，我们提出了一种名为 CINFormer 的 UNet 结构，以实现表面缺陷分割。CINFormer 在编码器中采用了简单而有效的特征整合机制，将输入图像的多层级 CNN 特征注入到 Transformer 网络的不同阶段，以保持 CNN 捕捉详细特征的优点和 Transformer 压制背景噪音的优点，从而实现准确的缺陷检测。此外，CINFormer 通过引入 Top-K 自注意力模块，可以聚焦于与缺陷相关的更重要信息的标记，以进一步减少冗余背景的影响。通过在 DAGM 2007、磁砖和 NEU 等表面缺陷数据集上进行的大量实验证明，CINFormer 在缺陷检测方面达到了最先进的性能。