Infrared and Visible Image Registration in UAV Inspection

Luoqiao Xiang,Liaoying Zhao,Shuhan Chen,Xiaorun Li
DOI: https://doi.org/10.1145/3579109.3579121
2022-01-01
Abstract:Infrared and visible dual camera is commonly used in UAV inspection. As a crucial preprocess, accurate registration can promote subsequent multi-source image fusion, which can improve detectability and reduce the false positive rate. Due to significant geometric distortions, gray-scale differences and partial overlap between infrared image and visible image, feature-based methods or joint area-feature based methods cannot obtain satisfactory results. To solve this problem, this paper presents a novel registration method based on UAV imaging characteristics and intensity-structure similarity optimization. The reliable initial registration parameters are obtained by utilizing the UAV imaging parameters and approximate coaxial imaging principle. For further improving the accuracy of registration, this paper proposes an intensity-structure similarity metric and the final rectification parameters are obtained by maximizing the proposed metric via quantum particle swarm optimization (QPSO) method. The experimental results of infrared and visible images in UAV inspection of photovoltaic power station demonstrate that the proposed method is competitive against traditional feature-based methods (FBMs), such as SIFT and SURF, and the joint area-feature based methods (AFBMs) based on SIFT combined with regional mutual information.
What problem does this paper attempt to address?