Efficient single image non-uniformity correction algorithm

Yohann Tendero,Jerome Gilles,Stephane Landeau,Jean-Michel Morel
DOI: https://doi.org/10.1117/12.864804
2024-11-07
Abstract:This paper introduces a new way to correct the non-uniformity (NU) in uncooled infrared-type images. The main defect of these uncooled images is the lack of a column (resp. line) time-dependent cross-calibration, resulting in a strong column (resp. line) and time dependent noise. This problem can be considered as a 1D flicker of the columns inside each frame. Thus, classic movie deflickering algorithms can be adapted, to equalize the columns (resp. the lines). The proposed method therefore applies to the series formed by the columns of an infrared image a movie deflickering algorithm. The obtained single image method works on static images, and therefore requires no registration, no camera motion compensation, and no closed aperture sensor equalization. Thus, the method has only one camera dependent parameter, and is landscape independent. This simple method will be compared to a state of the art total variation single image correction on raw real and simulated images. The method is real time, requiring only two operations per pixel. It involves no test-pattern calibration and produces no "ghost artifacts".
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the application of non - uniformity (NU) correction in uncooled infrared images. Specifically, the main problem of uncooled infrared cameras is that the non - uniformity of sensor responses drifts slowly over time, resulting in time - dependent noise in each column (or row), which is manifested as 1D flicker within the columns (or rows) in a frame. Traditional movie deflickering algorithms can be adapted to equalize these columns (or rows), but usually require multiple - frame images or complex scene conditions. ### Specific description of the problem: 1. **Non - uniformity problem**: Due to manufacturing process mismatches, each pixel sensor in uncooled infrared images reads out different values under the same illumination conditions, resulting in fixed - pattern noise (FPN) in the image. For uncooled cameras, this non - uniformity is not static but changes slowly over time, so non - uniformity correction (NUC) needs to be updated regularly. 2. **Limitations of existing methods**: - **Calibration - based techniques**: They require interrupting the image stream for black - body radiation calibration and are not suitable for real - time applications. - **Scene - based techniques**: They involve motion compensation or time accumulation, are complex and require specific viewing conditions. ### New method proposed in the paper: The paper proposes a single - frame non - uniformity correction algorithm that is directly applied to static images and does not require registration, camera motion compensation or closed - aperture sensor equalization. This method only depends on one camera - related parameter and is independent of the scene. By applying the classical movie deflickering algorithm to the columns (or rows) of infrared images, this method can achieve real - time non - uniformity correction on a single - frame image and avoid the generation of "ghost artifacts". ### Key innovation points: - **Real - time performance**: This method only needs to perform two operations on each pixel and can achieve real - time processing. - **No calibration required**: It does not require test - pattern calibration, simplifying the application process. - **High - quality results**: Sufficient image quality can be obtained after single - frame correction, which is suitable for many application scenarios. By comparing with the existing total variation (TV) single - frame correction methods, the paper demonstrates the superior performance of the new method on real and simulated images.