Abstract:Thermal infrared and multispectral visible remote sensing image fusion combines thermal image information with corresponding visible scene content to generate a better representative fused image. Thermal images can distinguish targets using difference in thermal radiation measurements, whereas visible images contain better texture detail in multispectral wavelength bands. The article presents a novel methodology named CLIM to sharpen coarser spatial resolution multispectral remote sensing images using relatively higher spatial resolution broadband thermal infrared image. The boundary-preserving information is extracted from high resolution thermal infrared image using co-occurrence image filter, and is combined with Laplacian of Gaussian based sharpened image to extract salient features for injection. In addition, visible image is transformed to IHS color space, and intensity component is enhanced using CLAHE and inverse transformation to generate enhanced visible image for fusion. The procedure developed is evaluated with Indian Nano Satellite (INS) broadband thermal infrared images available at a spatial resolution of 175 m with same day acquisition MODIS multispectral visible images available at a relatively coarser spatial resolution of 500 m. The nearest acquisition of Landsat-8 thermal infrared images with MODIS multispectral visible images is also used for infrared–visible multi-modal image fusion. The CLIM fused image confirms that distinct features such as dam, ship docking zones and refinery regions, are better demarked and semantically more meaningful in comparison with individual thermal infrared and multispectral visible image. The proposed CLIM approach is compared with, and found to perform better than state-of-the-art image fusion techniques, both visually and quantitatively.

Low-Light Visible and Infrared Image Fusion in NSST Domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

Enhanced low-light image fusion through multi-stage processing with Bayesian analysis and quadratic contrast function

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Infrared and Visible Image Fusion Using Intensity Transfer and Phase Congruency in Nonsubsampled Shearlet Transform Domain

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN

Infrared and visible image fusion using saliency detection based on shearlet transform

Infrared and Visible Image Fusion Based on NSCT and Stacked Sparse Autoencoders

EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

A novel image fusion algorithm for infrared and visible light

Multi-modal medical image fusion in NSST domain for internet of medical things

An improved hybrid multiscale fusion algorithm based on NSST for infrared–visible images

CLIM: Co-occurrence with Laplacian Intensity Modulation and Enhanced Color Space Transform for Infrared-Visible Image Fusion