Abstract:Anomaly detection is a crucial means to detect unbalanced and multiclass abnormal data in industrial products. The existing anomaly detection model is usually suitable for products with a simple or regular background texture. However, there is a lack of a universal surface defect anomaly detection framework for railway products when facing the challenges: the complex background texture, huge intraclass variation, uneven distribution of interclass, and weak texture-featured defects. To fill this gap, an innovative generative adversarial network based on adaptive pyramid graph (APG) and variation residuals (APGVR-GAN) is proposed, aiming to improve the robustness of anomaly detection in railway products and other complex industrial supplies. First, the APG module is embedded in the encoder–decoder–encoder pattern, capturing the correlation description between neighbor regions, which is utilized to enhance the detection of abnormal defects with weak texture. Next, the variation residual module is employed to enhance the expression of various normal samples in the latent space and improve the identification ability for abnormal samples. Then, the dual-probability prototype loss is proposed to make different normal samples have more concentrated expression and more similar probability distribution centers in latent space. Finally, an adaptive focal-gate loss and a regularized log-likelihood loss are designed to overcome the imbalance problem in training samples with different background information. The effectiveness of the model is verified on three new railway datasets and three other industrial public datasets. The results show that in anomaly detection, APGVR-GAN on the three railway datasets, Northeastern University (NEU)-the rail surface defects dataset (RSDD)-1 dataset, NEU-RSDD-1 dataset, and RSDD area under curve (AUC) [that is the receiver operating characteristic curve (ROC)], can reach 0.89, 0.81, and 0.87, and its detection accuracy (ACC) reached 0.97, 0.96, and 0.92, which is much higher than other comparative anomaly detection algorithms. In the segmentation experiments on the RSDD dataset, compared with other known rail defect detection methods, the overall evaluation metric F-Score is 83.70 which is also better than other methods.

A Hierarchical Transfer-Generative Framework for Automating Multi-Analytical Tasks in Rail Surface Defect Inspection

Computer Vision-Based Railway Viaduct Component Inspection Using Multi-task Multi-scale Deep Neural Network

Image Generation and Recognition for Railway Surface Defect Detection

Rail Surface Defect Detection Using A Transformer-Based Network

Hybrid deep learning architecture for rail surface segmentation and surface defect detection

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

Method for Rail Surface Defect Detection Based on Neural Network Architecture Search

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

AEGLR-Net

Hierarchical Multi-Scale Network for Cross-Scale Visual Defect Detection

An Adaptive Pyramid Graph and Variation Residual-Based Anomaly Detection Network for Rail Surface Defects

Research on deep learning method for rail surface defect detection

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

Multialgorithm Fusion Image Processing for High Speed Railway Dropper Failure–Defect Detection

Automatic railroad track components inspection using real‐time instance segmentation

A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains

Intelligent Detection of Surface Defects in High‐Speed Railway Ballastless Track Based on Self‐Attention and Transfer Learning

A Multi-Modal Approach to Rail Surface Condition Analysis: the MFDF-Net

Real-Time Defect Detection of Track Components: Considering Class Imbalance and Subtle Difference Between Classes

Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks

An effective framework using identification and image reconstruction algorithm for train component defect detection