Abstract:With the wide-spread of smartphones, mobile phone screen has become an important IO device in HCI and its quality is of great matter in interaction. Traditional defect detection process involves heavy labor cost or relies on unstable low-level features and suffers from both scale and model sensitive problems. Screen defect varies in size, shape, intensity and is hard to be described. Efficient and accurate detection system remains an urgent need in mobile phone screen manufacturing. In this paper, we propose an end-to-end screen defect detection framework. A defect detection network with merging and splitting strategies (MSDDN) to deal with multiple size and shape variations of defect image patches is firstly designed. After training, feature maps of the last layer before the output of MSDDN can be regarded as good representations of a screen image patch. These feature maps are concatenated into a unified feature vector. We then train a recurrent neural network (SCN) to decide which input screen image patch in a sequence is the most likely to contain defects, where the patches are cropped from the same image, and the feature maps are used as input. As SCN emphasizes on the comparison of image patches from one image, it is less sensitive to different screen batches. The patch with the highest probability of containing defects, or called focus area, is further processed with a sliding window to fill in the MSDDN to produce the final results. Finally, to improve the efficiency of the calculation process to fulfill the real industrial demand, we perform both filter selection and weight quantization on the weights in MSDDN under the purpose of building a low-precision version network without great loss in accuracy (MSDDN-l). Experimental results show MSDDN can better handle the defect variations than traditional models and general purpose convolutional neural networks. Meanwhile, SCN can accurately predict the focus area, and MSDDN-l can greatly improve the efficiency.

Mobile Phone Surface Defect Detection Based on Improved Faster R-CNN

Road Defect Detection from On-Board Cameras with Scarce and Cross-Domain Data

Surface Defect Detection of Mobile Phone Screen Based on Generative Adversarial Networks

A Smart Surface Inspection System Using Faster R-CNN in Cloud-Edge Computing Environment

Real Time Detection of Surface Defects with Inception-Based MobileNet-SSD Detection Network

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Defective Surface Detection Based on Improved Faster R-CNN

An Efficient Network for Surface Defect Detection

A Mobile Phone Screen Cover Glass Defect Detection MODEL Based on Small Samples Learning

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Small-scale defect detection in industrial environment based on lightweight deep learning network

Few-Shot Classification of Screen Defects with Class-Agnostic Mask and Context-Based Classifier.

CNN-Based Surface Defect Detection of Smartphone Protective Screen

Visual Defect Inspection of Metal Part Surface via Deformable Convolution and Concatenate Feature Pyramid Neural Networks

An enhanced method for surface defect detection in workpieces based on improved MobileNetV2‐SSD

An Improved Defect Detection Method for Substation Equipment

Detection of surface defect on flexible printed circuit via guided box improvement in GA-Faster-RCNN network

Detection of PCB Surface Defects With Improved Faster-RCNN and Feature Pyramid Network

Robustness defect detection: Improving the performance of surface defect detection in interference environment

Scale insensitive and focus driven mobile screen defect detection in industry

Tile Surface Defect Detection Based on Improved Faster R-CNN