Mark Points Detection and Measurement on Reflective Surfaces for In-Situ Machining of Large and Complex Components

Di Yang,Fugui Xie,Xin-Jun Liu
DOI: https://doi.org/10.1109/acirs62330.2024.10684914
2024-01-01
Abstract:Large and complex components are the core parts of major equipment. In the in-situ machining of these components, the precise alignment of cutting tools and part features is very important and also very challenging, and accurate measurement is the foundation. However, the reflective metal surfaces of these large components present significant challenges for the detection and measurement of visual markers on their surfaces. This paper presents a method for the detection and the three-dimensional reconstruction of markers on high-reflective components. The proposed method integrates the DEtection TRansformer (DETR) model and employs a data augmentation strategy to enhance model generalization. Segmentation of the regions of interest (ROI) of markers is employed to mitigate the issue of high reflectivity on surfaces. An enhanced ellipse detection method is developed that integrates multi-channel information from RGB images with a weighted grayscale image, leading to a significant improvement in the detection rate of visual markers. The effectiveness of the method is validated through comparative experiments with a laser tracker. The measurement experiment results show that the maximum measurement error is 0.0523 mm, and the average error is 0.0363 mm. The accuracy of the proposed method can meet the actual requirements, and the problem of high-reflection is solved. The study presents a feasible solution for marker detection and measurement in in-situ manufacturing of large and complex components.
What problem does this paper attempt to address?