Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

Interpolation sub-pixel mapping based on multiple subpixel shifted images based on a consideration of the point spread function effect

An optimization method for registration and mosaicking of remote sensing images

Deep Convolutional Neural Network Framework for Subpixel Mapping

Subpixel water area mapping based on spatial information processing at superpixel scale for multispectral imagery

SUBPIXEL MAPPING OF HYPERSPECTRAL IMAGE BASED ON LINEAR SUBPIXEL FEATURE DETECTION AND OBJECT OPTIMIZATION

Multi-Spectral Remote Sensing Image Enhancement Method Based on Pca and Ihs Transformations

Subpixel Mapping of Hyperspectral Image Based on Multiscale and Multifeature

Spatiotemporal Super-Resolution Mapping by Considering the Point Spread Function Effect

Subpixel Mapping Method of Hyperspectral Images Based on Modified Binary Quantum Particle Swarm Optimization

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Spatiotemporal Subpixel Mapping Based on Priori Remote Sensing Image With Variation Differences

Improving spatiotemporal image fusion incorporating unmixing step by considering the point spread function effect

Sub-pixel mapping with point constraints

Subpixel Mapping Based on Multisource Remote Sensing Fusion Data for Land-Cover Classes

Multiobjective Spatiotemporal Subpixel Mapping for Remote Sensing Imagery

Linear Feature Detection for Hyperspectral Subpixel Mapping

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Moving Picture Interpolation Algorithm Based on Texture Direction

Video Frame Interpolation with Many-to-many Splatting and Spatial Selective Refinement