Abstract:Mixed pixel problem is omnipresent in remote sensing images for urban land use interpretation due to the hardware limitations. Subpixel mapping (SPM) is a usual way to solve this problem by improving the observation scale and realizing a finer spatial resolution land cover mapping. Recently, deep learning-based subpixel mapping network (DLSMNet) was proposed, benefited from its strong representation and learning ability, to restore a visually pleasing finer mapping. However, the spatial context features of artifacts are usually aggregated and progressively lost during the forward pass of the network without sufficient representation, which make it difficult to be learned and restored. In this article, a semantic information modulated (SIM) deep subpixel mapping network (SIMNet) is proposed, which uses low-resolution semantic images as prior, to reinforce the representation of spatial context features. In SIMNet, SIM module is proposed to parametrically incorporate the semantic prior into the state-of-the-art (SOTA) feed forward network architecture in an end-to-end training fashion. Furthermore, stacked SIM module with residual blocks (SIM_ResBlock) is adopted to pass the representation of spatial context feature to the deep layers, to get it fully learned during backpropagation. Experiments have been implemented on three public urban scenario data sets, and the SIMNet generates a clearer outline of artificial facilities with sufficient spatial context, and is distinctive for even individual building, which is challenging for other SOTA DLSMNet. The results demonstrate that the proposed SIMNet is a promising way for high-resolution urban land use mapping from easily available lower resolution remote sensing images.Mixed pixel problem is omnipresent in remote sensing images for urban land use interpretation due to the hardware limitations. Subpixel mapping (SPM) is a usual way to solve this problem by improving the observation scale and realizing a finer spatial resolution land cover mapping. Recently, deep learning-based subpixel mapping network (DLSMNet) was proposed, benefited from its strong representation and learning ability, to restore a visually pleasing finer mapping. However, the spatial context features of artifacts are usually aggregated and progressively lost during the forward pass of the network without sufficient representation, which make it difficult to be learned and restored. In this article, a semantic information modulated (SIM) deep subpixel mapping network (SIMNet) is proposed, which uses low-resolution semantic images as prior, to reinforce the representation of spatial context features. In SIMNet, SIM module is proposed to parametrically incorporate the semantic prior into the state-of-the-art (SOTA) feed forward network architecture in an end-to-end training fashion. Furthermore, stacked SIM module with residual blocks (SIM_ResBlock) is adopted to pass the representation of spatial context feature to the deep layers, to get it fully learned during backpropagation. Experiments have been implemented on three public urban scenario data sets, and the SIMNet generates a clearer outline of artificial facilities with sufficient spatial context, and is distinctive for even individual building, which is challenging for other SOTA DLSMNet. The results demonstrate that the proposed SIMNet is a promising way for high-resolution urban land use mapping from easily available lower resolution remote sensing images.

Deep Hierarchical Pyramid Network With High- Frequency -Aware Differential Architecture for Super-Resolution Mapping

Deep Convolutional Neural Network Framework for Subpixel Mapping

Rethinking the High Frequency Components in Deep Sub-Pixel Mapping Network

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Pyramid-Structured Depth MAP Super-Resolution Based on Deep Dense-Residual Network

Guided Depth Map Super-Resolution Using Recumbent Y Network

Single-image Super-Resolution Via Selective Multi-Scale Network

Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution.

Deep Subpixel Mapping Based on Semantic Information Modulated Network for Urban Land Use Mapping.

High-resolution Depth Maps Imaging Via Attention-based Hierarchical Multi-modal Fusion

Multi-Scale Feature Mapping Network for Hyperspectral Image Super-Resolution

Dynamic High-Resolution Network for Semantic Segmentation in Remote-Sensing Images

Multi-depth branch network for efficient image super-resolution

Super-resolution for terrain modeling using deep learning in high mountain Asia

Lightweight Image Super-Resolution Reconstruction with Hierarchical Feature-Driven Network.

Digging into Depth and Color Spaces: A Mapping Constraint Network for Depth Super-Resolution

Deep Spatial Feedback Refined Network With Multilevel Feature Fusion for Hyperspectral Image Subpixel Mapping

Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation

Fast Hierarchical Depth Super-Resolution Via Guided Attention.

Hierarchical Feature Aggregation and Self-Learning Network for Remote Sensing Image Continuous-Scale Super-Resolution