Abstract:Anomaly detection is a crucial means to detect unbalanced and multiclass abnormal data in industrial products. The existing anomaly detection model is usually suitable for products with a simple or regular background texture. However, there is a lack of a universal surface defect anomaly detection framework for railway products when facing the challenges: the complex background texture, huge intraclass variation, uneven distribution of interclass, and weak texture-featured defects. To fill this gap, an innovative generative adversarial network based on adaptive pyramid graph (APG) and variation residuals (APGVR-GAN) is proposed, aiming to improve the robustness of anomaly detection in railway products and other complex industrial supplies. First, the APG module is embedded in the encoder–decoder–encoder pattern, capturing the correlation description between neighbor regions, which is utilized to enhance the detection of abnormal defects with weak texture. Next, the variation residual module is employed to enhance the expression of various normal samples in the latent space and improve the identification ability for abnormal samples. Then, the dual-probability prototype loss is proposed to make different normal samples have more concentrated expression and more similar probability distribution centers in latent space. Finally, an adaptive focal-gate loss and a regularized log-likelihood loss are designed to overcome the imbalance problem in training samples with different background information. The effectiveness of the model is verified on three new railway datasets and three other industrial public datasets. The results show that in anomaly detection, APGVR-GAN on the three railway datasets, Northeastern University (NEU)-the rail surface defects dataset (RSDD)-1 dataset, NEU-RSDD-1 dataset, and RSDD area under curve (AUC) [that is the receiver operating characteristic curve (ROC)], can reach 0.89, 0.81, and 0.87, and its detection accuracy (ACC) reached 0.97, 0.96, and 0.92, which is much higher than other comparative anomaly detection algorithms. In the segmentation experiments on the RSDD dataset, compared with other known rail defect detection methods, the overall evaluation metric F-Score is 83.70 which is also better than other methods.

Text-Guided Image Generation for Railway Intrusion Anomaly Detection

Intrusion Detection of Railway Clearance from Infrared Images Using Generative Adversarial Networks

Intrusion Detection of Abnormal Objects for Railway Scenes Using Infrared Images

Emage: Non-Autoregressive Text-to-Image Generation

Image Generation and Recognition for Railway Surface Defect Detection

Data augmentation using generative models for track intrusion detection

An Illegal Target Intrusion Detection System of Railway Based on Deep Learning and Hough Transform

An Effective Railway Intrusion Detection Method Using Dynamic Intrusion Region and Lightweight Neural Network

An Adaptive Pyramid Graph and Variation Residual-Based Anomaly Detection Network for Rail Surface Defects

Generative Model-Driven Synthetic Training Image Generation: An Approach to Cognition in Railway Defect Detection

AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model

RailFOD23: A dataset for foreign object detection on railroad transmission lines

Railway Intrusion Detection Based on Refined Spatial and Temporal Features for UAV Surveillance Scene

Generative Model-Driven Synthetic Training Image Generation: An Approach to Cognition in Rail Defect Detection

Local and Global Information in Obstacle Detection on Railway Tracks

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

ContRail: A Framework for Realistic Railway Image Synthesis using ControlNet

Railway obstacle intrusion warning mechanism integrating YOLO-based detection and risk assessment

Anomaly-GAN: A data augmentation method for train surface anomaly detection

Enhanced Few-Shot Learning for Intrusion Detection in Railway Video Surveillance

Railway Intrusion Detection Based on Machine Vision: A Survey, Challenges, and Perspectives