Abstract:The complementary combination of emphasizing target objects in infrared images and rich texture details in visible images can effectively enhance the information entropy of fused images, thereby providing substantial assistance for downstream composite high-level vision tasks, such as nighttime vehicle intelligent driving. However, mainstream fusion algorithms lack specific research on the contradiction between the low information entropy and high pixel intensity of visible images under harsh light nighttime road environments. As a result, fusion algorithms that perform well in normal conditions can only produce low information entropy fusion images similar to the information distribution of visible images under harsh light interference. In response to these problems, we designed an image fusion network resilient to harsh light environment interference, incorporating entropy and information theory principles to enhance robustness and information retention. Specifically, an edge feature extraction module was designed to extract key edge features of salient targets to optimize fusion information entropy. Additionally, a harsh light environment aware (HLEA) module was proposed to avoid the decrease in fusion image quality caused by the contradiction between low information entropy and high pixel intensity based on the information distribution characteristics of harsh light visible images. Finally, an edge-guided hierarchical fusion (EGHF) module was designed to achieve robust feature fusion, minimizing irrelevant noise entropy and maximizing useful information entropy. Extensive experiments demonstrate that, compared to other advanced algorithms, the method proposed fusion results contain more useful information and have significant advantages in high-level vision tasks under harsh nighttime lighting conditions.

Vehicles? Anti-blooming Method Based on Visible and Infrared Images Fusion

Infrared and visible image fusion method based on saliency detection and target-enhancement

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion

Nighttime vehicle detection based on illumination visibility recognition

Nighttime Vehicle Detection Based on Bio-Inspired Image Enhancement and Weighted Score-Level Feature Fusion

Infrared and Harsh Light Visible Image Fusion Using an Environmental Light Perception Network

Color-preserving visible and near-infrared image fusion for removing fog

Visible and Near Infrared Image Fusion Based on Texture Information

Infrared and Visible Image Fusion under Different Illumination Conditions Based on Illumination Effective Region Map.

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

Visual Enhancement Method for Intelligent Vehicle Based on Brightness Guide Filtering Algorithm

An Efficient Haze Removal Algorithm Using Chromatic Properties

Real-time automotive night-vision system for drivers to inhibit headlight glare of the oncoming vehicles and enhance road visibility

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and Visible Image Fusion Using Threshold Segmentation and Weight Optimization

Air infrared small target local dehazing based on multiple-factor fusion cascade network

Hyperspectral Image-Based Night-Time Vehicle Light Detection Using Spectral Normalization and Distance Mapper for Intelligent Headlight Control

A Dual-Mode Intensity and Polarized Imaging System for Assisting Autonomous Driving

Night-Time Vehicle Detection Algorithm Based on Visual Saliency and Deep Learning.