Abstract:As the consumer electronics industry develops, surface anomaly detection methods support the identification of anomalous products that have surface flaws and defects to prevent them from entering the commodity market. However, the scarcity and variety of types of anomalous product surfaces pose significant challenges to deep learning models, preventing them from effectively capturing the features associated with surface abnormalities and thus exacerbating the difficulty of surface anomaly detection. To address this problem, we propose a vision-language interaction method via contrastive learning for surface anomaly detection in the consumer electronics manufacturing domain. First, surface images of consumer electronics products are captured from surveillance video during the manufacturing process, and product specifications in the form of texts are collected from production plans and manufacturing requirements. They are encoded as embedding sequences and then transformed into feature vectors via a self-attention mechanism. We use the deep learning model to learn visual information about the appearance of a product from images and language descriptions of its key features, such as its shape, colour, and texture, from texts. Second, a contrastive learning method is used to interact with vision and language information to learn feature representations from images and texts. This approach fuses the text features and then copies these fused features to equal the number of image features for composing feature pairs. The primary objective is to maximize the similarity between these pairs, thereby enhancing the overall performance. Third, a similarity-based classification method is employed to accurately identify anomalous targets by calculating the degree of cosine similarity between each pair of image and text features. If the similarity is greater than the given threshold, the product is assumed to be good; otherwise, it is anomalous. Finally, experiments conducted on public datasets such as CIFAR-10, MNIST, and Fashion-MNIST demonstrate the applicability of the proposed approach in the realm of consumer electronics manufacturing.

Contrastive Learning of Defect Prototypes under Natural Language Supervision

Prototype-Based Supervised Contrastive Learning Method for Noisy Label Correction in Tire Defect Detection

Unifying Defect Prediction, Categorization, and Repair by Multi-Task Deep Learning

Cross-domain few-shot defect recognition for metal surfaces

Defect Detection for Wear Debris Based on Few-Shot Contrastive Learning

Vision-Language Interaction via Contrastive Learning for Surface Anomaly Detection in Consumer Electronics Manufacturing

A Learning-Based Approach for Surface Defect Detection Using Small Image Datasets

Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed

Augmented Hybrid Learning for Visual Defect Inspection in Real-World Hydrogen Storage Manufacturing Scenarios

Multi-Attribute Consistency Driven Visual Language Framework for Surface Defect Detection

Large-Scale Visual Language Model Boosted by Contrast Domain Adaptation for Intelligent Industrial Visual Monitoring

Human-Machine Hybrid Strategy for Defect Semantic Segmentation with Limited Data

Adaptive Cross Transformer with Contrastive Learning for Surface Defect Detection

DDPM-MoCo: Advancing Industrial Surface Defect Generation and Detection with Generative and Contrastive Learning

Defects Detection in Weld Joints Based on Visual Attention and Deep Learning

CoRe: Contrastive and Restorative Self-Supervised Learning for Surface Defect Inspection

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Automatic Classification of Weld Defects in Radiographic Images

Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning

Steel surface defect detection based on self-supervised contrastive representation learning with matching metric

A Multitask Learning-Based Neural Network for Defect Detection on Textured Surfaces Under Weak Supervision