Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

CNN-based subpixel rendering technique with additional pixel arrangement information for high quality displays

Deep Convolutional Neural Network Framework for Subpixel Mapping

Lightweight Image Super-Resolution Network Using 3D Convolutional Neural Networks

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolution

Subpixel Image Quality Assesement Syncretizing Local Subpixel and Global Pixel Features.

Subpixel Image Quality Assessment Syncretizing Local Subpixel and Global Pixel Features

High-Quality Real-Time Rendering Using Subpixel Sampling Reconstruction

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Subpixel Rendering: from Font Rendering to Image Subsampling [applications Corner]

Novel 2-D MMSE Subpixel-Based Image Down-Sampling

Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images.

Deep Sampling Networks

An Analytical Study Of Subpixel-Based Image Down-Sampling Patterns In Frequency Domain

SSPU-Net: Self-Supervised Point Cloud Upsampling via Differentiable Rendering

Lightweight Single Image Super-Resolution with Selective Channel Processing Network

Super resolution for subpixel-based downsampled images

Accelerating Image Super-Resolution Networks with Pixel-Level Classification

FPPN: fast pixel purification network for single-image super-resolution

Progressive Splitting and Upscaling Structure for Super-Resolution