Abstract:Hyperspectral pansharpening consists of fusing a high-resolution panchromatic band and a low-resolution hyperspectral image to obtain a new image with high resolution in both the spatial and spectral domains. These remote sensing products are valuable for a wide range of applications, driving ever growing research efforts. Nonetheless, results still do not meet application demands. In part, this comes from the technical complexity of the task: compared to multispectral pansharpening, many more bands are involved, in a spectral range only partially covered by the panchromatic component and with overwhelming noise. However, another major limiting factor is the absence of a comprehensive framework for the rapid development and accurate evaluation of new methods. This paper attempts to address this issue. We started by designing a dataset large and diverse enough to allow reliable training (for data-driven methods) and testing of new methods. Then, we selected a set of state-of-the-art methods, following different approaches, characterized by promising performance, and reimplemented them in a single PyTorch framework. Finally, we carried out a critical comparative analysis of all methods, using the most accredited quality indicators. The analysis highlights the main limitations of current solutions in terms of spectral/spatial quality and computational efficiency, and suggests promising research directions. To ensure full reproducibility of the results and support future research, the framework (including codes, evaluation procedures and links to the dataset) is shared on <a class="link-external link-https" href="https://github.com/matciotola/hyperspectral_pansharpening_toolbox" rel="external noopener nofollow">this https URL</a>, as a single Python-based reference benchmark toolbox.

Implementation and comparative quantitative assessment of different multispectral image pansharpening approches

Assessing Full-Resolution Pansharpening Quality: A Comparative Study of Methods and Measurements.

Spectral Fidelity and Spatial Enhancement: An Assessment and Cascading of Pan-Sharpening Techniques for Satellite Imagery

Hyperspectral Pansharpening: A Review

Full-Resolution Quality Assessment for Pansharpening

Comparison of Nine Hyperspectral Pansharpening Methods

Multi-spectral Image Panchromatic Sharpening, Outcome and Process Quality Assessment Protocol

Enhanced Back-Projection As Postprocessing for Pansharpening

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery

Quality Assessment by Region and Land Cover of Sharpening Approaches Applied to GF-2 Imagery

Pansharpening Using Guided Filtering to Improve the Spatial Clarity of VHR Satellite Imagery

Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm

A Two-Stage Pansharpening Method for the Fusion of Remote-Sensing Images

Spatial and Spectral Analysis of Resampling Algorithms in Image Fusion of Optical and Microwave Satellite Images: A Case Study Over Western Himalayas

A Pan-Sharpening Method Based on the ADMM Algorithm

A Survey of Pansharpening Methods with A New Band-Decoupled Variational Model

Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectives

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

Comprehensive Analysis and Improvements in Pansharpening Using Deep Learning

Pan-sharpening Based on Common Saliency Feature Analysis and Multiscale Spatial Information Extraction for Multiple Remote Sensing Images