Abstract:The computer-vision-based surface defect detection of metal planar materials is a research hotspot in the field of metallurgical industry. The high standard of planar surface quality in the metal manufacturing industry requires that the performance of an automated visual inspection system and its algorithms are constantly improved. This paper attempts to present a comprehensive survey on both two-dimensional and three-dimensional surface defect detection technologies based on reviewing over 160 publications for some typical metal planar material products of steel, aluminum, copper plates and strips. According to the algorithm properties as well as the image features, the existing two-dimensional methodologies are categorized into four groups: statistical, spectral, model, and machine learning-based methods. On the basis of three-dimensional data acquisition, the three-dimensional technologies are divided into stereoscopic vision, photometric stereo, laser scanner, and structured light measurement methods. These classical algorithms and emerging methods are introduced, analyzed, and compared in this review. Finally, the remaining challenges and future research trends of visual defect detection are discussed and forecasted at an abstract level.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
The paper mainly focuses on the automated visual inspection technology for surface defects of metal flat materials (such as steel plates, aluminum plates, copper plates, and strips), which is a research hotspot in the field of metallurgical industry. With the increasing demands for surface quality of metal flat materials in the manufacturing industry, the performance of automated visual inspection systems and their algorithms needs to be continuously improved. This article attempts to comprehensively review the computer vision-based two-dimensional (2D) and three-dimensional (3D) surface defect detection technologies, reviewing over 160 related literatures, and classifies and discusses the surface defect detection technologies for typical metal flat materials such as steel, aluminum, and copper.
In the 2D methods, existing technologies are divided into four categories based on algorithm characteristics and image features: statistical methods, spectral methods, model-based methods, and machine learning methods. 3D technologies, based on 3D data acquisition, are divided into methods such as stereo vision, photometric stereo, laser scanning, and structured light measurement. The paper compares and analyzes these classic algorithms and emerging methods and discusses the challenges and future research trends of visual defect detection at an abstract level.
The paper first introduces the widespread application of metal flat materials in industries such as automotive manufacturing, bridge construction, aerospace, and the impact of surface defects on product quality and corporate economic benefits. Then, it describes in detail the role of automated visual inspection equipment in improving product quality and production efficiency, as well as challenges encountered in actual industrial production, such as high reflectivity surfaces, pseudo-defect interference, random elastic deformation, and massive image data.
In addition, the paper also reviews past survey literature, pointing out that there is currently a lack of comprehensive reviews covering both 2D and 3D detection algorithms. To fill this gap, this article not only summarizes 2D visual inspection methods but also introduces 3D detection technologies, providing a reference for scholars and engineers engaged in visual inspection research in the field of automated manufacturing.
Finally, the paper emphasizes the importance of quantitative evaluation methods in surface defect detection tasks, defining nine metrics including true positive rate, false positive rate, precision rate, recall rate, accuracy rate, G-mean, and F-measure to measure detection effectiveness. By comparing and analyzing the performance of different methods, it provides direction and basis for subsequent research.