Abstract:In heterogeneous image fusion problems, different imaging mechanisms have always existed between time-of-flight and visible light heterogeneous images which are collected by binocular acquisition systems in orchard environments. Determining how to enhance the fusion quality is key to the solution. A shortcoming of the pulse coupled neural network model is that parameters are limited by manual experience settings and cannot be terminated adaptively. The limitations are obvious during the ignition process, and include ignoring the impact of image changes and fluctuations on the results, pixel artifacts, area blurring, and the occurrence of unclear edges. Aiming at these problems, an image fusion method in a pulse coupled neural network transform domain guided by a saliency mechanism is proposed. A non-subsampled shearlet transform is used to decompose the accurately registered image; the time-of-flight low-frequency component, after multiple lighting segmentation using a pulse coupled neural network, is simplified to a first-order Markov situation. The significance function is defined as first-order Markov mutual information to measure the termination condition. A new momentum-driven multi-objective artificial bee colony algorithm is used to optimize the parameters of the link channel feedback term, link strength, and dynamic threshold attenuation factor. The low-frequency components of time-of-flight and color images, after multiple lighting segmentation using a pulse coupled neural network, are fused using the weighted average rule. The high-frequency components are fused using improved bilateral filters. The results show that the proposed algorithm has the best fusion effect on the time-of-flight confidence image and the corresponding visible light image collected in the natural scene, according to nine objective image evaluation indicators. It is suitable for the heterogeneous image fusion of complex orchard environments in natural landscapes.

Image Fusion Method Based on Directional Contrast-Inspired Unit-Linking Pulse Coupled Neural Networks in Contourlet Domain

A Novel Method of Image Fusion Based on Adaptive Unit-Linking PCNN

Fusion Algorithm of Infrared and Visible Images Based on NSCT and PCNN

A Novel Algorithm of Image Fusion Based on Adaptive ULPCNN Time Matrix

Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

A Better Algorithm for Fusion of Infrared and Visible Image Based on Curvelet Transform and Adaptive Pulse Coupled Neural Networks (PCNN)

Multi-sensor image fusion by NSCT-PCNN transform

A Fusion Algorithm for Infrared and Visible Images Based on RDU-PCNN and ICA-bases in NSST Domain

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

An Image Fusion Method Based on NSCT and Dual-channel PCNN Model

Microscopy Image Fusion Algorithm Based on Saliency Analysis and Adaptive M-Pulse-coupled Neural Network in Non-Subsampled Contourlet Transform Domain

Medical Image Fusion Algorithm Based on Nonlinear Approximation of Contourlet Transform and Regional Features.

A General Memristor-Based Pulse Coupled Neural Network with Variable Linking Coefficient for Multi-Focus Image Fusion

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

Image Fusion Algorithm Based on Orientation Information Motivated Pulse Coupled Neural Networks

A novel multi-focus image fusion method using PCNN in nonsubsampled contourlet transform domain

A Novel Image Fusion Algorithm Using an NSCT and a PCNN with Digital Filtering

A Novel Multi-focus Image Fusion Method Using Pulse Coupled Neural Network in Nonsubsampled Contourlet Transform Domain

Multi-Focus Image Fusion Based on the Improved Pcnn and Guided Filter

Multi-focus Infrared Image Fusion Based on Pulse Coupled Neural Networks in a Nonsubsampled Contourlet Transform Domain