Abstract:The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusion of visible and infrared light can avoid the disadvantages of two single sensors and, in fusing the advantages of both sensors, significantly improve the quality of the images. The fusion of infrared and visible images is widely used in agriculture, industry, medicine, and other fields. In this study, firstly, the architecture of mainstream infrared and visible image fusion technology and application was reviewed; secondly, the application status in robot vision, medical imaging, agricultural remote sensing, and industrial defect detection fields was discussed; thirdly, the evaluation indicators of the main image fusion methods were combined into the subjective evaluation and the objective evaluation, the properties of current mainstream technologies were then specifically analyzed and compared, and the outlook for image fusion was assessed; finally, infrared and visible image fusion was summarized. The results show that the definition and efficiency of the fused infrared and visible image had been improved significantly. however, there were still some problems, such as the poor accuracy of the fused image, and irretrievably lost pixels. There is a need to improve the adaptive design of the traditional algorithm parameters, to combine the innovation of the fusion algorithm and the optimization of the neural network, so as to further improve the image fusion accuracy, reduce noise interference, and improve the real-time performance of the algorithm.

A review on infrared and visible image fusion algorithms based on neural networks

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Infrared and Visible Image Fusion Technology and Application: A Review

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Infrared and Visible Image Fusion Based on Filtering Enhancement

A robust infrared and visible image fusion framework via multi-receptive-field attention and color visual perception

Multi-scale Convolutional Neural Networks and Saliency Weight Maps for Infrared and Visible Image Fusion

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and visible image fusion method based on principal component analysis network and multi-scale morphological gradient

Fusion of Infrared and Visible Images Based on Three-Scale Decomposition and ResNet Feature Transfer

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and visible image fusion algorithm based on spatial domain and image features