Abstract:Land use segmentation is a fundamental yet challenging task in remote sensing. Most current methods mainly take images as input and sometimes cannot achieve satisfactory results due to limited information. Inspired by the inherent relations between land cover and land use, we investigate land use segmentation using additional land cover data. The topological relations among land cover objects are beneficial for bridging the semantic gap between land cover and land use. Specifically, these relations are usually depicted by a geo-object-based graph structure. Deep convolutional neural networks (CNNs) are capable of extracting local patterns but fail to efficiently explore topological relations. In contrast, contextual relations among objects can be easily captured by graph convolutional networks (GCNs). In this study, we integrated CNNs and GCNs and proposed the CNN-enhanced HEterogeneous Graph Convolutional Network (CHeGCN) to incorporate local spectral-spatial features and long-range dependencies. We represent topological relations by heterogeneous graphs which are constructed with images and land cover data. Afterwards, we employed GCNs to build topological relations by graph reasoning. Finally, we fused CNN and GCN features to accomplish the inference from land cover to land use. Compared with other homogeneous graph-based models, the land cover data provide more sufficient information for graph reasoning. The proposed method can achieve the transformation from land cover to land use. Extensive experiments showed the competitive performance of CHeGCN and demonstrated the positive effects of land cover data. On the IoU metric over two datasets, CHeGCN outperforms CNNs and GCNs by nearly 3.5% and 5%, respectively. In contrast to homogeneous graphs, heterogeneous graphs have an IoU improvement of approximately 2.5% in the ablation experiments. Furthermore, the generated visualizations help explore the underlying mechanism of CHeGCN. It is worth noting that CHeGCN can be easily degenerated to scenarios where no land cover information is available and achieves satisfactory performance.

Coupling Dual Graph Convolution Network and Residual Network for Local Climate Zone Mapping

Local Climate Zone Mapping by Coupling Multilevel Features With Prior Knowledge Based on Remote Sensing Images

A Co-Training Approach to the Classification of Local Climate Zones with Multi-Source Data.

Mapping and analyzing the local climate zones in China’s 32 major cities using Landsat imagery based on a novel convolutional neural network

Mapping Local Climate Zones in the Urban Environment: the Optimal Combination of Data Source and Classifier.

Mapping Impervious Surfaces in Town–Rural Transition Belts Using China’s GF-2 Imagery and Object-Based Deep CNNs

Global heterogeneous graph convolutional network: from coarse to refined land cover and land use segmentation

LLNet: Lightweight Network with a Channel and Spatial Attention Mechanism for Local Climate Zone Classification from Sentinel‐2 image

Developing a CNN-based, block-scale oriented Local Climate Zone mapping approach: A case study in Guangzhou

SAR and Multi-Spectral Data Fusion for Local Climate Zone Classification with Multi-Branch Convolutional Neural Network

Local Climate Zone Classification via Semi-Supervised Multimodal Multiscale Transformer

Improving Urban Land Cover/Use Mapping by Integrating A Hybrid Convolutional Neural Network and an Automatic Training Sample Expanding Strategy

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

A Scene Unmixing Deep Learning Network for Local Climate Zone Mapping and Analysis Using Very High Resolution Remote Sensing Imagery

A Deep Neural Network Combined CNN and GCN for Remote Sensing Scene Classification

Deep learning-based local climate zone classification using Sentinel-1 SAR and Sentinel-2 multispectral imagery

Dual-Coupled CNN-GCN-Based Classification for Hyperspectral and LiDAR Data

S2RC-GCN: A Spatial-Spectral Reliable Contrastive Graph Convolutional Network for Complex Land Cover Classification Using Hyperspectral Images

Learning Spatial Interaction Representation with Heterogeneous Graph Convolutional Networks for Urban Land-Use Inference

CNN-Enhanced Heterogeneous Graph Convolutional Network: Inferring Land Use from Land Cover with a Case Study of Park Segmentation

Deep Transfer Model Based Local Climate Zone Classification Using SAR/Multispectral Images