Abstract:Deep-learning-based detection methods have been widely applied to industrial defect inspection. However, directly using vanilla detection methods fails to achieve satisfying performance due to the lack of identifiable features. In this article, a novel attention-based multiscale feature fusion module (AMFF) is proposed, aiming to enhance defect features and improve defect identification by leveraging attention mechanism in the feature fusion. AMFF includes self-enhanced attention module (SEAM) and cross-enhanced attention module (CEAM). SEAM is performed on a single feature map, which first adopts multiple dilation convolutions to enrich contextual information without compromising resolution and then utilizes the intralayer attention on the current feature map. CEAM takes both the current feature map and the adjacent feature map as input to perform cross-layer attention. The adjacent feature map is modulated with the guidance of the current feature map, which is then combined with the current feature map and the output of SEAM for final prediction. AMFF is utilized in current feature fusion networks, e.g., feature pyramid network (FPN) and path aggregation FPN (PAFPN), and is further integrated into prevalent detectors to guide them to pay more attention to defects rather than the background. Extensive experiments are conducted on two real industrial datasets released by Tianchi platform, i.e., fabric and aluminum defect datasets. For each dataset, 500 images are randomly selected for test and the rest for training. The proposed AMFF is demonstrated to significantly boost defect detection accuracy with acceptable computational cost, and the real-time performance could fully satisfy practical requirements.

Detection of Defects in Power Grid Inspection Images Based on Multi-scale Fusion

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Multi-label image recognition for electric power equipment inspection based on multi-scale dynamic graph convolution network

Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces

Insulator defect detection algorithm based on multi-scale feature fusion optimization

Multi-scale Attention and Dilation Network for Small Defect Detection

Hierarchical Multi-Scale Network for Cross-Scale Visual Defect Detection

Multiscale Local and Global Feature Fusion for the Detection of Steel Surface Defects

A Convolutional Neural Network-Based Defect Recognition Method for Power Insulator

MFNet: A Novel Multilevel Feature Fusion Network With Multibranch Structure for Surface Defect Detection

A grid fault diagnosis framework based on adaptive integrated decomposition and cross-modal attention fusion

Attention-Based Multiscale Feature Fusion for Efficient Surface Defect Detection

E-VarifocalNet: A Lightweight Model to Detect Insulators and Their Defects under Power Grid Surveillance.

Research on defect recognition method of substation inspection images based on faster R-CNN

A Method for Surface Defect Detection Based on Multiscale Feature Fusion and Pyramid Attention

Power Insulator Defect Detection Based on Multi-scale Dense Adaptive Sensing

Surface defect detection of industrial components based on vision

A Flow-Appearance Fusion Defect Detection Method for Substation Equipment in Multi-Scene

Smart grid line fault detection based on deep learning image recognition algorithm

PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection