Abstract:Subpixel mapping (SPM) is an effective way to solve the mixed pixel problem, which is a ubiquitous phenomenon in remotely sensed imagery, by characterizing subpixel distribution within the mixed pixels. In fact, the majority of the classical and state-of-the-art SPM algorithms can be viewed as a convolution process, but these methods rely heavily on fixed and handcrafted kernels that are insufficient in characterizing a geographically realistic distribution image. In addition, the traditional SPM approach is based on the prerequisite of abundance images derived from spectral unmixing (SU), during which process uncertainty inherently exists and is propagated to the SPM. In this article, a kernel-learnable convolutional neural network (CNN) framework for subpixel mapping (SPMCNN-F) is proposed. In SPMCNN-F, the kernel is learnable during the training stage based on the given training sample pairs of low- and high-resolution patches for learning a geographically realistic prior, instead of fixed priors. The end-to-end mapping structure enables direct subpixel information extraction from the original coarse image, avoiding the uncertainty propagation from the SU. In the experiments undertaken in this study, two state-of-the-art super-resolution networks were selected as application demonstrations of the proposed SPMCNN-F method. In experiment part, three hyperspectral image data sets were adopted, two in a synthetic coarse image approach and one in a real coarse image approach, for the validation. Additionally, a new data set with pairs of Moderate-resolution Imaging Spectroradiometer (MODIS) and Landsat images were adopted in a real coarse image approach, for further validation of SPMCNN-F in large-scale area. The restored fine distribution images obtained in all the experiments showed a perceptually better reconstruction quality, both qualitatively and quantitatively, confirming the superiority of the proposed SPM framework.

Convolutional Neural Network-Based Registration for Mosaicing of Microscopic Images

Deep Convolutional Neural Network Framework for Subpixel Mapping

Multimodal registration of FISH and nanoSIMS images using convolutional neural network models

MosaicNet: A deep-learning-based multi-tile biomedical image stitching method

Microscopic Image Mosaic Algorithm Using Improved Optical Flow Method

Automatic image mosaic

Application of Convolutional Neural Network to Acquisition of Clear Images for Objects with Large Vertical Size in Stereo Light Microscope Vision System.

Novel OCT mosaicking pipeline with Feature- and Pixel-based registration

Robust Subpixel Registration For Image Mosaicing

Medical Image Mosaic Based On Low-Overlapping Regions

Feature Based Multi-Resolution Registration of Blurred Images for Image Mosaic

Registration Of Blurred Images For Image Mosaic

Mosaicing the Retinal Fundus Images: a Robust Registration Technique Based Approach

Feature-based image registration and mosaicing

Computational framework for generating large panoramic super-resolution images from localization microscopy

Robust Mosaicing of Endomicroscopic Videos Via Context-Weighted Correlation Ratio.

A Robust Mosaicing Method with Super-Resolution for Optical Medical Images.

DeepMapi: a Fully Automatic Registration Method for Mesoscopic Optical Brain Images Using Convolutional Neural Networks

Robust Endoscopic Image Mosaicking Via Fusion of Multimodal Estimation

Image panoramic mosaicing with global and local registration

Convolutional neural network advances in demosaicing for fluorescent cancer imaging with color-near-infrared sensors