Photometric Correction for Infrared Sensors

Jincheng Zhang,Kevin Brink,Andrew R Willis

DOI: https://doi.org/10.1109/CVPRW59228.2023.00049

2024-01-13

Abstract:Infrared thermography has been widely used in several domains to capture and measure temperature distributions across surfaces and objects. This methodology can be further expanded to 3D applications if the spatial distribution of the temperature distribution is available. Structure from Motion (SfM) is a photometric range imaging technique that makes it possible to obtain 3D renderings from a cloud of 2D images. To explore the possibility of 3D reconstruction via SfM from infrared images, this article proposes a photometric correction model for infrared sensors based on temperature constancy. Photometric correction is accomplished by estimating the scene irradiance as the values from the solution to a differential equation for microbolometer pixel excitation with unknown coefficients and initial conditions. The model was integrated into an SfM framework and experimental evaluations demonstrate the contribution of the photometric correction for improving the estimates of both the camera motion and the scene structure. Further, experiments show that the reconstruction quality from the corrected infrared imagery achieves performance on par with state-of-the-art reconstruction using RGB sensors.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The main problem this paper attempts to address is the photometric inaccuracy of infrared image sensors during 3D reconstruction. Specifically, due to the different response characteristics of infrared sensors (especially microbolometers) compared to traditional RGB cameras, the pixel values in infrared images cannot accurately reflect the true temperature distribution of the current scene in situations such as rapid temperature measurement, high frame rates, or moving scenes. This affects the quality of 3D reconstruction based on Structure from Motion (SfM).

To improve this situation, the paper proposes a photometric correction model for infrared sensors. This model is based on the principle of temperature constancy and corrects pixel values by estimating the irradiance of the scene. The model utilizes the physical response characteristics of microbolometers during heating and cooling processes and achieves photometric correction by solving differential equations that include unknown coefficients and initial conditions. Experimental results show that infrared images after photometric correction can significantly improve the accuracy of camera motion estimation and scene structure estimation in SfM applications. The quality of 3D reconstruction can be comparable to existing techniques using RGB sensors.

In summary, the core objective of the paper is to enhance the 3D reconstruction performance of infrared images under low-light conditions by proposing a new photometric correction method, particularly in application scenarios such as autonomous ground and aerial vehicle navigation.