Abstract:In heterogeneous image fusion problems, different imaging mechanisms have always existed between time-of-flight and visible light heterogeneous images which are collected by binocular acquisition systems in orchard environments. Determining how to enhance the fusion quality is key to the solution. A shortcoming of the pulse coupled neural network model is that parameters are limited by manual experience settings and cannot be terminated adaptively. The limitations are obvious during the ignition process, and include ignoring the impact of image changes and fluctuations on the results, pixel artifacts, area blurring, and the occurrence of unclear edges. Aiming at these problems, an image fusion method in a pulse coupled neural network transform domain guided by a saliency mechanism is proposed. A non-subsampled shearlet transform is used to decompose the accurately registered image; the time-of-flight low-frequency component, after multiple lighting segmentation using a pulse coupled neural network, is simplified to a first-order Markov situation. The significance function is defined as first-order Markov mutual information to measure the termination condition. A new momentum-driven multi-objective artificial bee colony algorithm is used to optimize the parameters of the link channel feedback term, link strength, and dynamic threshold attenuation factor. The low-frequency components of time-of-flight and color images, after multiple lighting segmentation using a pulse coupled neural network, are fused using the weighted average rule. The high-frequency components are fused using improved bilateral filters. The results show that the proposed algorithm has the best fusion effect on the time-of-flight confidence image and the corresponding visible light image collected in the natural scene, according to nine objective image evaluation indicators. It is suitable for the heterogeneous image fusion of complex orchard environments in natural landscapes.

PCNN-Based Image Fusion in Compressed Domain

IEF-CSNET: Information Enhancement and Fusion Network for Compressed Sensing Reconstruction

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

An Efficient Compressive Convolutional Network for Unified Object Detection and Image Compression

Image fusion in compressed sensing

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

Region-Based Image-Fusion Framework for Compressive Imaging

Multi-focus Image Fusion Using Pulse Coupled Neural Network.

A novel multi-focus image fusion method using PCNN in nonsubsampled contourlet transform domain

A Novel Image Fusion Algorithm Using an NSCT and a PCNN with Digital Filtering

Classification-based image-fusion framework for compressive imaging

Gradient-based Compressive Image Fusion

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

A General Memristor-Based Pulse Coupled Neural Network with Variable Linking Coefficient for Multi-Focus Image Fusion

Fusion Research of Remote Sensing Image Based on Compressive Sensing

Application of deep learning model based on image definition in real-time digital image fusion

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

BEMD Image Fusion Based on PCNN and Compressed Sensing.

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

Images Fusion Based on Block Compressed Sensing and Multiwavelet Transform