Abstract:In heterogeneous image fusion problems, different imaging mechanisms have always existed between time-of-flight and visible light heterogeneous images which are collected by binocular acquisition systems in orchard environments. Determining how to enhance the fusion quality is key to the solution. A shortcoming of the pulse coupled neural network model is that parameters are limited by manual experience settings and cannot be terminated adaptively. The limitations are obvious during the ignition process, and include ignoring the impact of image changes and fluctuations on the results, pixel artifacts, area blurring, and the occurrence of unclear edges. Aiming at these problems, an image fusion method in a pulse coupled neural network transform domain guided by a saliency mechanism is proposed. A non-subsampled shearlet transform is used to decompose the accurately registered image; the time-of-flight low-frequency component, after multiple lighting segmentation using a pulse coupled neural network, is simplified to a first-order Markov situation. The significance function is defined as first-order Markov mutual information to measure the termination condition. A new momentum-driven multi-objective artificial bee colony algorithm is used to optimize the parameters of the link channel feedback term, link strength, and dynamic threshold attenuation factor. The low-frequency components of time-of-flight and color images, after multiple lighting segmentation using a pulse coupled neural network, are fused using the weighted average rule. The high-frequency components are fused using improved bilateral filters. The results show that the proposed algorithm has the best fusion effect on the time-of-flight confidence image and the corresponding visible light image collected in the natural scene, according to nine objective image evaluation indicators. It is suitable for the heterogeneous image fusion of complex orchard environments in natural landscapes.

Image Fusion Based on Nonsubsampled Contourlet Transform and Saliency-Motivated Pulse Coupled Neural Networks

Multi-sensor image fusion by NSCT-PCNN transform

Fusion Algorithm of Infrared and Visible Images Based on NSCT and PCNN

Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain

Vision Model Based Image Fusion in Nonsubsampled Contourlet Transform Domain

Saliency preserved image fusion using nonsubsampled contourlet transform

Image Fusion Technique Based on Non-Subsampled Contourlet Transform and Adaptive Unit-Fast-linking Pulse-Coupled Neural Network

A Novel Image Fusion Algorithm Using an NSCT and a PCNN with Digital Filtering

Multifocus Image Fusion Scheme Based on Nonsubsampled Contourlet Transform

A Novel Fusion Method Using NSCT and PCNN

A Novel Multi-focus Image Fusion Method Using Pulse Coupled Neural Network in Nonsubsampled Contourlet Transform Domain

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

Microscopy Image Fusion Algorithm Based on Saliency Analysis and Adaptive M-Pulse-coupled Neural Network in Non-Subsampled Contourlet Transform Domain

NSCT-PCNN Image Fusion Based on Image Gradient Motivation

A novel multi-focus image fusion method using PCNN in nonsubsampled contourlet transform domain

Technique for Image Fusion Based on Nonsubsampled Shearlet Transform and Improved Pulse-Coupled Neural Network

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

A Better Algorithm for Fusion of Infrared and Visible Image Based on Curvelet Transform and Adaptive Pulse Coupled Neural Networks (PCNN)

Fusion of Infrared and Visible I mages Based on Edge Featu re and Adaptive PCNN in NSCT Do main

Multi-modal Image Fusion Based on Saliency Guided in NSCT Domain.

An Effective Image Fusion Method Based On Nonsubsampled Contourlet Transform And Pulse Coupled Neural Network