A highlight removal method of components with high reflective surface measurement based on binocular vision

Peidong Zhang,Wenqi Wang,Wei Liu,Wenlong Zhang,Yang Zhang
DOI: https://doi.org/10.1117/12.2607083
2021-11-24
Abstract:Binocular stereo vision technology plays an essential role in the intelligent manufacturing system due to the advantages of high accuracy and non-contact. However, for the measurement of components with highly reflective surfaces such as metal and ceramic, the specular reflections affected by the complex light field lead to the failure of feature matching and the decrease of measurement accuracy. This paper proposes an imaging strategy for binocular vision and a high dynamic image processing method to suppress the effect of specular reflection for stereo matching. Firstly, the mechanism of highlight generation in the image is analyzed by combining the illumination reflection theory of the BRDF model. Then, a binocular vision system with a parallel optical axis is built to capture images under different illumination conditions. The image processing algorithm of high dynamic range image fusion is studied, and an algorithm based on tone mapping and weight fusion is implemented to remove the high-lights. Finally, an experiment was performed to verify the effectiveness of the proposed method by a robust and fast matching algorithm. An image evaluation method based on BRISQUE further demonstrates the effectiveness of the method. Compared to the original images, the quality score of the HDR images is lower, which means that the processed images are of better quality. Moreover, the method provides an increase of 23.33% in image matching accuracy, which verifies the availability applied in the measurement of highly reflective surface components.
What problem does this paper attempt to address?