Abstract:Fusing hyperspectral image (HSI) and multispectral image (MSI) of high spatial resolution is typically utilized to obtain HSIs of high spatial resolution. However, the spatial quality of most existing methods is unsatisfactory due to the limited spatial resolution of an MSI. To further improve the spatial resolution of the fused HSI while keeping the spectral information well, we propose a new computational paradigm, named HyperFusion, which simultaneously fuses HSI, MSI, and panchromatic (PAN) image. To achieve this goal, we first establish two data fidelity terms based on a physical observation that HSI and MSI can be treated as degraded versions of the fused HSI. Consequently, the spatial and spectral information from HSI and MSI can be well preserved. To efficiently transfer the spatial details of PAN into the fused HSI while keeping the spectral information well, we further construct a prior constraint from PAN based on the structural similarity. Meanwhile, we impose another low-rank prior constraint on the coefficient matrix to accurately describe the latent characteristics of the HSI with high spatial resolution. By incorporating the aforementioned data fidelity terms and prior constraints, we finally formulate the objective as an optimization problem and utilize the alternative direction multiplier method to solve it efficiently. Comprehensive experiments on simulated and real datasets are carried out to demonstrate the superiority of HyperFusion over other state of the arts in terms of visual quality and quantitative analysis. We also adopt a simulated experiment of vegetation coverage index analysis to verify the effectiveness of HyperFusion in remote sensing applications.

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries.

HyperFusion: A Computational Approach for Hyperspectral, Multispectral, and Panchromatic Image Fusion

Fusion of Multispectral and Panchromatic Images Based on a Novel Inter-Band Structure Model

Multimodal Sensors Image Fusion for Higher Resolution Remote Sensing Pan Sharpening

Hyperspectral and Panchromatic Image Fusion Via Adaptive Tensor and Multi-Scale Retinex Algorithm

Improved Multiresolution Analysis Method For Hyperspectral Pansharpening

Recent Advances and New Guidelines on Hyperspectral and Multispectral Image Fusion

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Hyperspectral and Panchromatic Image Fusion Through an Improved Ratio Enhancement

Fusion of Hyperspectral and Panchromatic Images Using an Average Filter and a Guided Filter.

A Fusion Method For Multispectral And Panchromatic Images Based On Hsi And Contourlet Transformation

Improving the Spatial Resolution of Hyperspectral Image Using Panchromatic and Multispectral Images: an Integrated Method

Fusion of Hyperspectral and Panchromatic Images Using Generative Adversarial Network and Image Segmentation

Pansharpening for Multiband Images with Adaptive Spectral–Intensity Modulation

Multi-Frequency Spectral–Spatial Interactive Enhancement Fusion Network for Pan-Sharpening

Structure Tensor-Based Algorithm for Hyperspectral and Panchromatic Images Fusion.

Integrated Fusion for Panchromatic, Multispectral, Hyperspectral Remote Sensing Images With Different Swath Widths

Hyperspectral Image Fusion Based on Multistage Guided Filter

Pansharpening Based On An Improved Ratio Enhancement

Hyper-Sharpening Based on Spectral Modulation.