Abstract:Due to the limitation of imaging equipment, it is difficult to acquire hyperspectral images (HSIs) with high spatial resolution directly. Existing approaches improve the resolution of HSIs by fusing multispectral image (MSI) and HSI. However, most of them are only feed-forward. They only learn low-resolution (LR) to high-resolution (HR) feature mappings without considering the ill-posedness of super-resolution tasks, leading to a large solution space of mapping functions and making it difficult to learn a complete mapping function. Moreover, there is a large resolution difference between HSI and MSI, and some up-sampling operations are inevitably employed in the network. Nevertheless, traditional upsampling methods only represent pixel points in a discrete way, failing to adequately restore the continuous spatial and spectral information. To this end, this article proposes a spatial-spectral implicit neural representation network for hyperspectral and multispectral image fusion (SS-INR). Inspired by the success of implicit neural representation (INR) in continuum reconstruction, we design spatial-INR and spectral-INR for spatial and spectral resolution reconstruction, respectively. SS-INR contains two processes: forward fusion (FF) and back-projection fusion (BPF). In the FF process, the input HSI is first spatially upsampled with spatial-INR to overcome spatial resolution differences while performing initial fusion with MSI. In the BPF process, we explore the spatial and spectral degradation processes and use them as prior knowledge for error correction. Extensive experiments on five public hyperspectral datasets demonstrate the effectiveness of SS-INR, and SS-INR achieves competitive results compared with existing state-of-the-art (SOTA) fusion methods. The source code for SS-INR will be released at https://github.com/wxy11-27/SS-INR .

STSR-INR: Spatiotemporal super-resolution for multivariate time-varying volumetric data via implicit neural representation

HR-INR: Continuous Space-Time Video Super-Resolution via Event Camera

Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolution

Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data

SS-INR: Spatial-Spectral Implicit Neural Representation Network for Hyperspectral and Multispectral Image Fusion

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolution

VSpSR: Explorable Super-Resolution Via Variational Sparse Representation

Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

HyperINR: A Fast and Predictive Hypernetwork for Implicit Neural Representations via Knowledge Distillation

GaussianSR: High Fidelity 2D Gaussian Splatting for Arbitrary-Scale Image Super-Resolution

Self‐attention residual network‐based spatial super‐resolution synthesis for time‐varying volumetric data

SSR-VFD: Spatial Super-Resolution for Vector Field Data Analysis and Visualization.

FFEINR: flow feature-enhanced implicit neural representation for spatiotemporal super-resolution

FFEINR: Flow Feature-Enhanced Implicit Neural Representation for Spatio-temporal Super-Resolution

Spatial attention-based implicit neural representation for arbitrary reduction of MRI slice spacing

SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution

Scalable Super-Resolution Neural Operator

STrCNeRF: an Implicit Neural Representation Method Combining Global and Local Features from an Image for Novel View Synthesis

Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning