Abstract:The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.

Bi-channel Video Fusion Human Invasion Detection Based on Neural Network

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Video Based Head Detection and Tracking Surveillance System

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Transformer fusion and histogram layer multispectral pedestrian detection network

Pedestrian detection-driven cascade network for infrared and visible image fusion

Multi-view and Multi-Plane Data Fusion for Effective Pedestrian Detection in Intelligent Visual Surveillance

Detecting Violence in Video Based on Deep Features Fusion Technique

Real-time Human Detection in Fire Scenarios using Infrared and Thermal Imaging Fusion

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

Infrared and Visible Imagery Fusion Based on Region Saliency Detection for 24-Hour-surveillance Systems

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Bayesian Fusion of Laser and Vision for Multiple People Detection and Tracking

Multi-Source Information Fusion network for building occupancy estimation

Asymmetric Adaptive Fusion in a Two-Stream Network for RGB-D Human Detection

Human Behavior Recognition of Video Surveillance System Based on Neural Network

Robust Pedestrian Detection Based on Multi-Spectral Image Fusion and Convolutional Neural Networks

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

An Infrared and Visible Image Fusion Method Based on Adaptive Weight Learning