PSO-Based Optimal Coverage Path Planning for Surface Defect Inspection of 3C Components with a Robotic Line Scanner

Hongpeng Chen,Shengzeng Huo,Muhammad Muddassir,Hoi-Yin Lee,Anqing Duan,Pai Zheng,David Navarro-Alarcon

2024-07-28

Abstract:The automatic inspection of surface defects is an important task for quality control in the computers, communications, and consumer electronics (3C) industry. Conventional devices for defect inspection (viz. line-scan sensors) have a limited field of view, thus, a robot-aided defect inspection system needs to scan the object from multiple viewpoints. Optimally selecting the robot's viewpoints and planning a path is regarded as coverage path planning (CPP), a problem that enables inspecting the object's complete surface while reducing the scanning time and avoiding misdetection of defects. However, the development of CPP strategies for robotic line scanners has not been sufficiently studied by researchers. To fill this gap in the literature, in this paper, we present a new approach for robotic line scanners to detect surface defects of 3C free-form objects automatically. Our proposed solution consists of generating a local path by a new hybrid region segmentation method and an adaptive planning algorithm to ensure the coverage of the complete object surface. An optimization method for the global path sequence is developed to maximize the scanning efficiency. To verify our proposed methodology, we conduct detailed simulation-based and experimental studies on various free-form workpieces, and compare its performance with a state-of-the-art solution. The reported results demonstrate the feasibility and effectiveness of our approach.

Robotics

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the quality control problem of automatic surface defect detection in the 3C industry (computers, communications, and consumer electronics). Specifically, due to the limited field of view, traditional line - scan sensors cannot comprehensively scan the surfaces of 3C components with complex shapes, resulting in incomplete or inefficient defect detection. Therefore, this paper proposes a new method that uses a robotic line - scan system to automatically detect surface defects on 3C free - form surface components. This method aims to improve the comprehensiveness and efficiency of detection, reduce scanning time, and avoid missing defect detection by optimizing the Coverage Path Planning (CPP).

### Main contributions:
1. **New area segmentation method and Adaptive Region of Interest (ROI) algorithm**: Used to define local scanning paths on free - form surfaces with complex and high - imaging - quality requirements.
2. **Particle Swarm Optimization (PSO) - based global detection path generation method**: Aims to minimize the detection time.
3. **Detailed simulations, experiments, and comparisons**: To verify the effectiveness of the proposed method.

### Method overview:
- **Hybrid area segmentation**: Combines the Random Sample Consensus (RANSAC) and K - means clustering methods to divide the complex surfaces of 3C components into flatter and more manageable areas.
- **Adaptive ROI path planning**: Generates local scanning paths according to the segmented areas to ensure that each area can be fully covered.
- **PSO - based global path optimization**: Connects the local paths in the optimal order to form a global coverage path to minimize the total detection time.

### Mathematical formulas:
- **Plane model**:
\[
aX + bY + cZ + d = 0
\]
where \([a, b, c, d]^T\) are the plane model parameters, and \([X, Y, Z]^T\) represents any point in 3D coordinates.

- **Similarity calculation**:
\[
\alpha_{ij}=\omega_1\cos\left(\frac{\mathbf{n}_r^i\cdot\mathbf{q}_n}{|\mathbf{n}_r^i|\cdot|\mathbf{q}_n|}\right)+\omega_2\cos\left(\frac{\mathbf{c}_r^i\cdot\mathbf{q}_c}{|\mathbf{c}_r^i|\cdot|\mathbf{q}_c|}\right)
\]
where \(\omega_1\) and \(\omega_2\) are weight factors, set to 0.6 and 0.4 respectively.

- **Global path optimization objective function**:
\[
\min\left(\sum_{t = 1}^{U}\sum_{s = 1}^{U - 1}(T_{\text{scanning}}^t+T_{\text{across}}^s)\right)
\]
where \(T_{\text{scanning}}^t\) is the cost time through each local path \(G_t\), \(T_{\text{across}}^s\) is the cost time from \(G_t\) to \(G_{t + 1}\), and \(U\) is the total number of local paths.

### Conclusion:
The method proposed in this paper demonstrates the feasibility and effectiveness in the surface defect detection of 3C components, especially in improving the detection efficiency and accuracy. By combining the new area segmentation method, adaptive ROI path planning, and PSO - based global path optimization, this method can effectively address the limitations of traditional methods and provides a new solution for industrial product quality monitoring.