Abstract:Sub-pixel mapping is the prevailing approach for dealing with the mixed pixel effect in urban land use/land cover classification, by reconstructing the sub-pixel-scale distribution inside each mixed-pixel based on spatial autocorrelation. However, 1) traditional spatial autocorrelation is limited to a local window, which cannot model the teleconnection between two locations or objects that are far apart and 2) autocorrelation is based on the idea of “the more proximate, the more similar”, which relies on a distance-weight decay parameter and cannot characterize the rich variety of mutual information in spatially heterogenous areas in urban. In this research, we develop and demonstrate a learnable correlation-based sub-pixel mapping (LECOS) method. 1) We use the “mutual retrieval” mechanism of the self-attention operation to model teleconnections that enable more distant locations or objects to be mutually correlated and 2) we design a parameter-free “self-attention in self-attention” operation to learn adaptively the diverse global correlation patterns between pixel and sub-pixel. The learned spatial correlations are then used for reasoning the sub-pixel-scale distribution of each class. We validated our method on the most challenging public datasets of urban scenes, which exhibit considerable spatial heterogeneity with complex structures and broken objects. The learned building-tree, building-road and road-tree correlation patterns contributed most to the sub-pixel reconstruction result of the urban scenes, consistent with in-situ reference data. We further explored the model's explicability in a large-area of several metropolises in China, by mapping land cover in these cities at a 2 m very fine spatial resolution using 10 m Sentinel-2 input images, and found that the derived result not only revealed rich urban spatial heterogeneity, but also that the learned correlation was indicative of urban pattern dynamics, suggesting the potential for greater understanding of issues such as urban fairness, accessibility, human exposure and sustainability.

Sub-pixel mapping for land class with linear features using least square support vector machine

Deep Convolutional Neural Network Framework for Subpixel Mapping

Linear Feature Detection for Hyperspectral Subpixel Mapping

SUBPIXEL MAPPING OF HYPERSPECTRAL IMAGE BASED ON LINEAR SUBPIXEL FEATURE DETECTION AND OBJECT OPTIMIZATION

Sub-pixel Mapping Method Based on BP Neural Network

A Sub-pixel Mapping Algorithm Based on BP Neural Network with Spatial Autocorrelation Function for Remote Sensing Imagery

Sub-Pixel Mapping Based on Bp Neural Network with Multiple Shifted Remote Sensing Images

Subpixel Mapping for Remote Sensing Images

Errata: Subpixel mapping on remote sensing imagery using a prediction model combining wavelet transform and radial basis function neural network

Subpixel Mapping Method of Hyperspectral Images Based on Modified Binary Quantum Particle Swarm Optimization

Improving Urban Land Cover/Use Mapping by Integrating A Hybrid Convolutional Neural Network and an Automatic Training Sample Expanding Strategy

Very fine spatial resolution urban land cover mapping using an explicable sub-pixel mapping network based on learnable spatial correlation

BP Neural Network Based SubPixel Mapping Method

Integration of Spatial Attractions Between and Within Pixels for Sub-Pixel Mapping

Fuzzy Nonlinear Proximal Support Vector Machine For Land Extraction Based On Remote Sensing Image

Improved Sub-Pixel Mapping Method Coupling Spatial Dependence with Directivity and Connectivity

Terrain re-sampling of imaging lidar based on support vector machines

Sub-Pixel Mapping Based on MAP Model and Spatial Attraction Theory for Remotely Sensed Image

Land-Cover Classification With High-Resolution Remote Sensing Images Using Interactive Segmentation

Non-Local Sub-Pixel Mapping for Hyperspectral Imagery

Building Simplification Using Backpropagation Neural Networks: a Combination of Cartographers' Expertise and Raster-Based Local Perception