Abstract:Urban land use classification plays a significant role in urban studies and provides key guidance for urban development. However, existing methods predominantly rely on either raster structure deep features through convolutional neural networks (CNNs) or topological structure deep features through graph neural networks (GNNs), making it challenging to comprehensively capture the rich semantic information in remote sensing images. To address this limitation, we propose a novel urban land use classification model by integrating both raster and topological structure deep features to enhance the accuracy and robustness of the classification model. First, we divide the urban area into block units based on road network data and further subdivide these units using the fractal network evolution algorithm (FNEA). Next, the K-nearest neighbors (KNN) graph construction method with adaptive fusion coefficients is employed to generate both global and local graphs of the blocks and sub-units. The spectral features and subgraph features are then constructed, and a graph convolutional network (GCN) is utilized to extract the node relational features from both the global and local graphs, forming the topological structure deep features while aggregating local features into global ones. Subsequently, VGG-16 (Visual Geometry Group 16) is used to extract the image convolutional features of the block units, obtaining the raster structure deep features. Finally, the transformer is used to fuse both topological and raster structure deep features, and land use classification is completed using the softmax function. Experiments were conducted using high-resolution Google images and Open Street Map (OSM) data, with study areas on the third ring road of Shenyang and the fourth ring road of Chengdu. The results demonstrate that the proposed method improves the overall accuracy and Kappa coefficient by 9.32% and 0.17, respectively, compared to single deep learning models. Incorporating subgraph structure features further enhances the overall accuracy and Kappa by 1.13% and 0.1. The adaptive KNN graph construction method achieves accuracy comparable to that of the empirical threshold method. This study enables accurate large-scale urban land use classification with reduced manual intervention, improving urban planning efficiency. The experimental results verify the effectiveness of the proposed method, particularly in terms of classification accuracy and feature representation completeness.

MM-UrbanFAC: Urban Functional Area Classification Model Based on Multimodal Machine Learning

Classification of Urban Functional Areas from Remote Sensing Images and Time-Series User Behavior Data

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

A multimodal fusion framework for urban scene understanding and functional identification using geospatial data

Evaluation Of Machine Learning-Based Urban Surface Mapping Using A New Moderate-Resolution Satellite Imagery Dataset

A multi‐modal transportation data‐driven approach to identify urban functional zones: An exploration based on Hangzhou City, China

Urban Land Use Classification Model Fusing Multimodal Deep Features

Mapping Urban Functional Areas Using Multisource Remote Sensing Images and Open Big Data.

A New Remote Sensing Images and Point-of-Interest Fused (RPF) Model for Sensing Urban Functional Regions

Multiscale Urban Functional Zone Recognition Based on Landmark Semantic Constraints

A New Fusion Approach for Extracting Urban Built-up Areas from Multisource Remotely Sensed Data.

Deep learning-based remote and social sensing data fusion for urban region function recognition

Remote Sensing and Time Series Data Fused Multimodal Prediction Model Based on Interaction Analysis

EXPLORING URBAN FUNCTIONAL ZONES BASED ON MULTI-SOURCE SEMANTIC KNOWLEDGE AND CROSS MODAL NETWORK

Multi-Scale Recursive Identification of Urban Functional Areas Based on Multi-Source Data

Identifying Urban Functional Regions: A Multi-Dimensional Framework Approach Integrating Metro Smart Card Data and Car-Hailing Data

MDFF: A Method for Fine-Grained UFZ Mapping with Multimodal Geographic Data and Deep Network

Classification of the Functions of Urban Area Based on Deep Learning.

Classification of Urban Functional Zones by Integrating Spatial Features of VHR Satellite Images and Semantic Features of POI Data.

Grid-Based Essential Urban Land Use Classification: A Data and Model Driven Mapping Framework in Xiamen City

A Multimodal Data Fusion Model for Accurate and Interpretable Urban Land Use Mapping with Uncertainty Analysis