Intensity matching through saliency maps for thermal and visible image registration for face detection applications
Krishnan, Palani Thanaraj,Balasubramanian, Parvathavarthini,Mahadevan, Shriraam
DOI: https://doi.org/10.1007/s00371-022-02605-z
2022-07-13
Abstract:Face identification is a common image processing problem that is used in a range of applications, including pedestrian tracking, population flow forecast, video surveillance, and fever screening. When combined with a visible-light camera, thermal imaging provides a more thorough image of the person. Face identification is commonly accomplished by combining data from many modalities, such as infrared(IR)/visible(VIS) pictures. The face detection system's success is contingent upon the image registration approach being of good quality. In this article, we demonstrate an improved intensity-based image registration approach for visual and thermal face pictures. The approach applies a saliency map strategy to balance the infrared and visible pictures' intensity levels in order to overcome intensity differences and ensure proper image registration. When applied to facial infrared and visible pictures, the proposed technique displays an improvement in registration quality when measured using the structural similarity index measure (SSIM) and universal image quality index (UQI) metrics. We report an average improvement of 16.93 % in terms of SSIM score and 7.02 % in terms of UQI score when the suggested image registration system is applied in comparison with unregistered images for the test IR/VIS face images. Furthermore, the proposed method outperformed the state-of-the-art Oriented FAST and Rotated BRIEF-based image registration methods in terms of image registration quality.
computer science, software engineering