Abstract:Hyperspectral pansharpening consists of fusing a high-resolution panchromatic band and a low-resolution hyperspectral image to obtain a new image with high resolution in both the spatial and spectral domains. These remote sensing products are valuable for a wide range of applications, driving ever growing research efforts. Nonetheless, results still do not meet application demands. In part, this comes from the technical complexity of the task: compared to multispectral pansharpening, many more bands are involved, in a spectral range only partially covered by the panchromatic component and with overwhelming noise. However, another major limiting factor is the absence of a comprehensive framework for the rapid development and accurate evaluation of new methods. This paper attempts to address this issue. We started by designing a dataset large and diverse enough to allow reliable training (for data-driven methods) and testing of new methods. Then, we selected a set of state-of-the-art methods, following different approaches, characterized by promising performance, and reimplemented them in a single PyTorch framework. Finally, we carried out a critical comparative analysis of all methods, using the most accredited quality indicators. The analysis highlights the main limitations of current solutions in terms of spectral/spatial quality and computational efficiency, and suggests promising research directions. To ensure full reproducibility of the results and support future research, the framework (including codes, evaluation procedures and links to the dataset) is shared on <a class="link-external link-https" href="https://github.com/matciotola/hyperspectral_pansharpening_toolbox" rel="external noopener nofollow">this https URL</a>, as a single Python-based reference benchmark toolbox.

A PyTorch Benchmark for High-Contrast Imaging Post Processing

Speckle Space-Time Covariance in High-Contrast Imaging

The high-contrast performance of the Keck Planet Imager and Characterizer

Direct Exoplanet Detection Using Deep Convolutional Image Reconstruction (ConStruct): A New Algorithm for Post-Processing High-Contrast Images

Fast-Cadence High-Contrast Imaging with Information Field Theory

Comparing Apples with Apples: Robust Detection Limits for Exoplanet High-Contrast Imaging in the Presence of non-Gaussian Noise

Direct Exoplanet Detection using Convolutional Image Reconstruction (ConStruct): A New Algorithm for Post-processing High-contrast Images

Imaging Analysis of the Hard X-ray Telescope ProtoEXIST2 and New Techniques for High Resolution Coded Aperture Telescopes

Speckle noise reduction techniques for high-dynamic range imaging

Use the 4S (Signal-Safe Speckle Subtraction): Explainable Machine Learning reveals the Giant Exoplanet AF Lep b in High-Contrast Imaging Data from 2011

Efficient Point-spread Function Modeling with ShOpt.jl: A Point-spread Function Benchmarking Study with JWST NIRCam Imaging

A Contrast Calibration Protocol for X-ray Speckle Visibility Spectroscopy

Post-processing CHARIS integral field spectrograph data with PyKLIP

Improving VLT/SPHERE without additional hardware: Comparing quasi-static correction strategies

Fringing analysis and forward modeling of Keck Planet Imager and Characterizer (KPIC) spectra

Pan-STARRS PSF-Matching for Subtraction and Stacking

Efficient PSF Modeling with ShOpt.jl: A PSF Benchmarking Study with JWST NIRCam Imaging

speckle-tracking: a software suite for ptychographic X-ray speckle tracking

Precision Speckle Pattern Reconstruction for High-contrast Imaging

Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectives

deepBlink: Threshold-independent detection and localization of diffraction-limited spots