Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

Ultra-High Resolution SVBRDF Recovery from a Single Image

SVBRDF Recovery from a Single Image with Highlights Using a Pre-trained Generative Adversarial Network

Bidirectional Texture Function Image Super-Resolution Using Singular Value Decomposition.

Deep Convolutional Neural Network Framework for Subpixel Mapping

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Single-image SVBRDF capture with a rendering-aware deep network

Joint SVBRDF Recovery and Synthesis from a Single Image Using an Unsupervised Generative Adversarial Network

An attention-embedded GAN for SVBRDF recovery from a single image

Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Flexible SVBRDF Capture with a Multi‐Image Deep Network

Single‐Image SVBRDF Estimation with Learned Gradient Descent

SVBRDF Reconstruction by Transferring Lighting Knowledge

UHDNeRF: Ultra-High-Definition Neural Radiance Fields

Modeling surface appearance from a single photograph using self-augmented convolutional neural networks

Acute mitral regurgitation after acute myocardial infarction in a patient with a patent foramen ovale: review of the diagnosis and management of acute ischemic mitral regurgitation.

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image

Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

High-quality super-resolution mapping using spatial deep learning

NeRF-SR: High Quality Neural Radiance Fields Using Supersampling