Abstract:The study presents an automated deep learning approach for surface defect identification using an improved RepVGG model (ViT‐RepVGG), incorporating the self‐attention mechanism of ViT. Various strategies for module addition and hyperparameter settings are explored, with performance compared to classic network models and recently published models, highlighting the model's effectiveness in complex industrial environments. In the production of strip steel, surface defect identification is crucial for improving product quality and ensuring smooth subsequent processes. Existing technologies face challenges such as low detection efficiency and susceptibility to environmental noise. This article employs an automated deep learning method without requiring consideration of complex environmental changes and proposes an improved RepVGG (ViT‐RepVGG) model for surface defect identification. The model is based on the RepVGG architecture, and the study explores the impact of incorporating the self‐attention mechanism of ViT under various addition strategies on model performance. A comparison is made between the optimized model and classic network models, as well as recently published models, in terms of identification performance. The research also examines the performance variations of the model under different hyperparameter settings and its identification performance for six types of defects. The results indicate that adding the ViT module to stage 3 of the A1‐type RepVGG, with a learning rate, optimizer, and activation function set to 0.0001, Adam, and Gelu, respectively, yields the optimal ViT‐RepVGG model performance. These findings demonstrate the feasibility of enhancing classification performance by incorporating the self‐attention mechanism into neural networks, providing an effective foundation for the online identification of strip steel surface defects.

Mixup Enhanced Linear Robust Explainable Model for Identifying Key Factors of Surface Defects in Strip Steel Manufacturing

XAIP: An eXplainable AI‐Based Pipeline for Identifying Key Factors of Surface Defects in Strip Steel

Depth feature fusion based surface defect region identification method for steel plate manufacturing

A ResNet50-Based Method for Classifying Surface Defects in Hot-Rolled Strip Steel

Surface defect detection of hot rolled steel based on multi-scale feature fusion and attention mechanism residual block

Research on surface defect detection model of steel strip based on MFFA‐YOLOv5

Surface Defect Identification of Strip Steel Using ViT‐RepVGG

A deep learning model for steel surface defect detection

Multi-scale sensing and multi-dimensional feature enhancement for surface defect detection of hot-rolled steel strip

A deep-learning-based approach for fast and robust steel surface defects classification

Learning Trustworthy Model from Noisy Labels based on Rough Set for Surface Defect Detection

Steel strip surface defect detection based on multiscale feature sensing and adaptive feature fusion

A Multi-scale Normalizing Flow Network for Surface Defects Detection

A steel surface defect inspection approach towards smart industrial monitoring

Steel surface roughness parameter prediction from laser reflection data using machine learning models

Steel Strip Surface Defect Detection Method Based on Improved YOLOv5s

Surface defect detection of strip steel based on GT-CutMix augmentation algorithm and improved DSSD model

Efficient Detection Model of Steel Strip Surface Defects Based on YOLO-V7

SDD-YOLO: A Lightweight, High-Generalization Methodology for Real-Time Detection of Strip Surface Defects

A lightweight image-level segmentation method for steel surface defects based on cross-layer feature fusion

Steel Surface Defect Recognition: A Survey