Abstract:Defect detection from images, an important application in the development of the industrial internet, has been gaining increasing attention due to its close relationship with product quality in industrial production. However, two major challenges in defect detection persist: (1) Limited availability of datasets. Deep learning-based models typically require large-scale training sets to achieve satisfactory detection results. (2) Insufficient image quality and low detection accuracy. When many object detection methods are applied to industrial defect detection, they often exhibit poor performance in handling unclear boundaries, complex backgrounds, noise, and textures. In this study, we propose an advanced defect detection method based on YOLO and Stable Diffusion (YOLO-SD). For the few-shot dataset, a controllable generation module is designed, that integrates CLIP, LoRA, and ControlNet based on Stable Diffusion. Among them, CLIP text inversion can generate the most suitable prompt words from the defect dataset, providing prompt input for Stable Diffusion. LoRA can intervene and adjust the image style of Stable Diffusion by training on the defect dataset in a fine-tuning way. ControlNet obtains boundary and depth maps through HED and Midas. For the insufficient image quality and low detection accuracy, an improved YOLO model with an attention-based Fusion Simulated Feature module (FSF) is built that extracts defect features of the original images and generated images, which provides richer semantic information to improve the detection accuracy. At the same time, in order to make the model lightweight, we introduce a test optimization strategy to improve the model training process. Extensive experiments on the NEU-DET steel defect dataset show that the images generated by our method can expand the dataset to train the model and achieve a certain improvement in defect detection.

DSFFNet: Tire Defect Detection Based on Deep and Shallow Feature Fusion

Tire Defect Detection Based on Low and High-level Feature Fusion

Tire Defect Detection Via 3D Laser Scanning Technology

An Improved YOLOv7-based Detection of Tire Defects for Driving Assistance

A Multi-Scale Feature Fusion Network for Chip Surface Defect Detection

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Attention-Based Multiscale Feature Fusion for Efficient Surface Defect Detection

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

A Lightweight Road Defect Detection Method Based on Multi-Scale Hybrid Feature Fusion

Decision Fusion Network with Perception Fine-tuning for Defect Classification

Defect Detection in Tire X-Ray Images: Conventional Methods Meet Deep Structures

HLU 2 -Net: A Residual U-Structure Embedded U-Net With Hybrid Loss for Tire Defect Inspection

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Deep Learning-Based Automatic Defect Detection Method for Sewer Pipelines

Research on X-ray nondestructive defect detection method of tire based on dynamic Snake Convolution YOLO model

Tire tread detection based on fusion of spatial and frequency domain features

Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection

TD-YOLOA: An Efficient YOLO Network With Attention Mechanism for Tire Defect Detection

TAF2-Net: Triple-Branch Attentive Feature Fusion Network for Ultrasonic Flaw Detection

Yolo-sd: simulated feature fusion for few-shot industrial defect detection based on YOLOv8 and stable diffusion