Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

Richer feature for image classification with super and sub kernels based on deep convolutional neural network

Research on Image Classification Method of Features of Combinatorial Convolution

Deep Convolutional Neural Network Framework for Subpixel Mapping

Depth Image Super-resolution via Two-Branch Network

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

HCFNN: High-order Coverage Function Neural Network for Image Classification

Melanoma Classification in Dermoscopy Images via Ensemble Learning on Deep Neural Network

The Treasure beneath Convolutional Layers: Cross-convolutional-layer Pooling for Image Classification

The Treasure Beneath Convolutional Layers: Cross-Convolutional-Iayer Pooling For Image Classification

DCNN: Dual Cross-current Neural Networks Realized Using An Interactive Deep Learning Discriminator for Fine-grained Objects

Cross-convolutional-layer Pooling for Generic Visual Recognition.

Research on image classification method based on convolutional neural network

A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

DBCTNet: Double Branch Convolution-Transformer Network for Hyperspectral Image Classification

Dual Complementary Dynamic Convolution for Image Recognition

Hyperspectral Image Classification Promotion Using Dynamic Convolution Based on Structural Re-Parameterization

Shallow Network Based on Depthwise Over-Parameterized Convolution for Hyperspectral Image Classification

Dual-Path Large Kernel Learning and Its Applications in Single-Image Super-Resolution

Blind Visual Quality Assessment for Image Super-Resolution by Convolutional Neural Network

A PCA-Based Convolutional Network