Attention-based deep learning for chip-surface-defect detection

Shuo Wang,Hongyu Wang,Fan Yang,Fei Liu,Long Zeng
DOI: https://doi.org/10.1007/s00170-022-09425-4
2022-06-07
Abstract:Unlike objects (such as cats and dogs) in the ImageNet, the surface defects on chips have a relatively tiny defect areas, yet they contain a large amount of information. The traditional deep learning methods have unsatisfied performance for tiny defects. Therefore, we proposed an object detection network combining attention with YOLOV4 for tiny defect detection, denoted as YOLOV4-SA. The network consists of a feature extraction backbone, a spatial attention module (SAM) and a feature fusion module. The SAM can correct the value of the feature map and highlight the defect areas, which identifies the tiny defects more effectively. To support current and future research, we also constructed a chip-surface-defect dataset, including a real set and a synthetic set. The real set contains non-defective and defective images. The synthetic set was generated by three new defect-generation methods. To the best of our knowledge, this is the first defect dataset in the field of advanced packaging chips. YOLOV4-SA was trained and tested on this dataset. Compared with classical defect detection methods, YOLOV4-SA achieved 78.47 mAP (mean of average precision), which was at least 7% better than other methods. For tiny ink and crack defects, the mAP was improved by 11.92 compared with YOLOV4. Lastly, we also proposed a cascading deployment method which may be useful for industrial applications.
engineering, manufacturing,automation & control systems
What problem does this paper attempt to address?