Abstract:In heterogeneous image fusion problems, different imaging mechanisms have always existed between time-of-flight and visible light heterogeneous images which are collected by binocular acquisition systems in orchard environments. Determining how to enhance the fusion quality is key to the solution. A shortcoming of the pulse coupled neural network model is that parameters are limited by manual experience settings and cannot be terminated adaptively. The limitations are obvious during the ignition process, and include ignoring the impact of image changes and fluctuations on the results, pixel artifacts, area blurring, and the occurrence of unclear edges. Aiming at these problems, an image fusion method in a pulse coupled neural network transform domain guided by a saliency mechanism is proposed. A non-subsampled shearlet transform is used to decompose the accurately registered image; the time-of-flight low-frequency component, after multiple lighting segmentation using a pulse coupled neural network, is simplified to a first-order Markov situation. The significance function is defined as first-order Markov mutual information to measure the termination condition. A new momentum-driven multi-objective artificial bee colony algorithm is used to optimize the parameters of the link channel feedback term, link strength, and dynamic threshold attenuation factor. The low-frequency components of time-of-flight and color images, after multiple lighting segmentation using a pulse coupled neural network, are fused using the weighted average rule. The high-frequency components are fused using improved bilateral filters. The results show that the proposed algorithm has the best fusion effect on the time-of-flight confidence image and the corresponding visible light image collected in the natural scene, according to nine objective image evaluation indicators. It is suitable for the heterogeneous image fusion of complex orchard environments in natural landscapes.

A Multi-Focus Color Image Fusion Algorithm Based on an Adaptive SF-PCNN in NSCT Domain

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-focus image fusion approach based on CNP systems in NSCT domain

Fractal Dimension-Based Multi-Focus Image Fusion via Coupled Neural P Systems in NSCT Domain

Multi-Focus Image Fusion via PAPCNN and Fractal Dimension in NSST Domain

Multi-Focus Image Fusion via Distance-Weighted Regional Energy and Structure Tensor in NSCT Domain

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Multi-Focus Image Fusion Algorithm in Sensor Networks

Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network

Multi-focus image fusion algorithm based on region detection and ACS network

Salience Preserving Multi-Focus Image Fusion

Multispectral and Panchromatic Image Fusion Based on Unsubsampled Contourlet Transform