Abstract:In heterogeneous image fusion problems, different imaging mechanisms have always existed between time-of-flight and visible light heterogeneous images which are collected by binocular acquisition systems in orchard environments. Determining how to enhance the fusion quality is key to the solution. A shortcoming of the pulse coupled neural network model is that parameters are limited by manual experience settings and cannot be terminated adaptively. The limitations are obvious during the ignition process, and include ignoring the impact of image changes and fluctuations on the results, pixel artifacts, area blurring, and the occurrence of unclear edges. Aiming at these problems, an image fusion method in a pulse coupled neural network transform domain guided by a saliency mechanism is proposed. A non-subsampled shearlet transform is used to decompose the accurately registered image; the time-of-flight low-frequency component, after multiple lighting segmentation using a pulse coupled neural network, is simplified to a first-order Markov situation. The significance function is defined as first-order Markov mutual information to measure the termination condition. A new momentum-driven multi-objective artificial bee colony algorithm is used to optimize the parameters of the link channel feedback term, link strength, and dynamic threshold attenuation factor. The low-frequency components of time-of-flight and color images, after multiple lighting segmentation using a pulse coupled neural network, are fused using the weighted average rule. The high-frequency components are fused using improved bilateral filters. The results show that the proposed algorithm has the best fusion effect on the time-of-flight confidence image and the corresponding visible light image collected in the natural scene, according to nine objective image evaluation indicators. It is suitable for the heterogeneous image fusion of complex orchard environments in natural landscapes.

Multi-modal Image Fusion with KNN Matting.

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Multi-sensor image fusion by NSCT-PCNN transform

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

An Image Fusion Method Based on NSCT and Dual-channel PCNN Model

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

A Novel Image Fusion Algorithm Using an NSCT and a PCNN with Digital Filtering

Multispectral and panchromatic images fusion by adaptive PCNN

A new method of image data fusion based on FNN

Multi-modality image fusion based on sparse representation and PCNN

A Novel Pixel-Level and Feature-Level Combined Multisensor Image Fusion Scheme

Multi-Sensor Image Fusion Using Optimized Support Vector Machine and Multiscale Weighted Principal Component Analysis

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Multi-focus Image Fusion Using PCNN

Multi-modal remote sensing image fusion method guided by local extremum maps-guided image filter

Multi-focus Infrared Image Fusion Based on Pulse Coupled Neural Networks in a Nonsubsampled Contourlet Transform Domain

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Multi-focus Image Fusion with Convolutional Neural Network Based on Dempster-Shafer Theory

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Multi-focus image fusion approach based on CNP systems in NSCT domain