Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

Color image demosaicking via deep residual learning

Deep Convolutional Neural Network Framework for Subpixel Mapping

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy

Joint Demosaicking And Blind Deblurring Using Deep Convolutional Neural Network

Jointly Learning Spectral Sensitivity Functions and Demosaicking Via Deep Networks

Joint learning of RGBW color filter arrays and demosaicking

Learning a Deep Demosaicing Network for Spike Camera With Color Filter Array

NTSDCN: New Three-Stage Deep Convolutional Image Demosaicking Network.

A Two-Stage Convolutional Neural Network for Joint Demosaicking and Super-Resolution

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Convolutional neural network advances in demosaicing for fluorescent cancer imaging with color-near-infrared sensors

Deep demosaicking for multispectral filter arrays

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Deep joint demosaicking and denoising

Universal Deep Demosaicking for Sparse Color Filter Arrays

Demosaicking Based on Channel-Correlation Adaptive Dictionary Learning

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

An Improved Color Image Demosaicking Algorithm

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

Convolutional Sparse Coding for Demosaicking with Panchromatic Pixels.

Color demosaicking via fully directional estimation