Abstract:Geographical object classification and information extraction is an important topic for the construction of 3D virtual reality and digital twin cities in urban areas. However, the majority of current multi-target classification of urban scenes uses only a single source data (optical remote sensing images or airborne laser scanning (ALS) point clouds), which is limited by the restricted information of the data source itself. In order to make full use of the information carried by multiple data sources, we often need to set more parameters as well as algorithmic steps. To address the above issues, we compared and analyzed the object classification methods based on data fusion of airborne LiDAR point clouds and optical remote sensing images, systematically. Firstly, the features were extracted and determined from airborne LiDAR point clouds and high-resolution optical images. Then, some key feature sets were selected and were composed of median absolute deviation of elevation, normalized elevation values, texture features, normal vectors, etc. The feature sets were fed into various classifiers, such as random forest (RF), decision tree (DT), and support vector machines (SVM). Thirdly, the suitable feature sets with appropriate dimensionality were composed, and the point clouds were classified into four categories, such as trees (Tr), houses and buildings (Ho), low-growing vegetation (Gr), and impervious surfaces (Is). Finally, the single data source and multiple data sources, the crucial feature sets and their roles, and the resultant accuracy of different classifier models were compared and analyzed. Under the conditions of different experimental regions, sampling proportion parameters and machine learning models, the results showed that: (1) the overall classification accuracy obtained by the feature-level data fusion method was 76.2% compared with the results of only a single data source, which could improve the overall classification accuracy by more than 2%; (2) the accuracy of the four classes in the urban scenes can reach 88.5% (Is), 76.7% (Gr), 87.2% (Tr), and 88.3% (Ho), respectively, while the overall classification accuracy can reach 87.6% with optimal sampling parameters and random forest classifiers; (3) the RF classifier outperforms DT and SVM for the same sample conditions. In this paper, the method based on ALS point clouds and image data fusion can accurately classify multiple targets in urban scenes, which can provide technical support for 3D scene reconstruction and digital twin cities in complex geospatial environments.

Classification of Urban Functional Areas from Remote Sensing Images and Time-Series User Behavior Data

High Spatial-Resolution Classification of Urban Surfaces Using a Deep Learning Method

Evaluation Of Machine Learning-Based Urban Surface Mapping Using A New Moderate-Resolution Satellite Imagery Dataset

MM-UrbanFAC: Urban Functional Area Classification Model Based on Multimodal Machine Learning

Classification of the Functions of Urban Area Based on Deep Learning.

A multi‐modal transportation data‐driven approach to identify urban functional zones: An exploration based on Hangzhou City, China

Mapping Urban Functional Areas Using Multisource Remote Sensing Images and Open Big Data.

Mapping essential urban land use categories with open big data: Results for five metropolitan areas in the United States of America

A Two-Phase Classification of Urban Vegetation Using Airborne LiDAR Data and Aerial Photography

Urban Functional Zone Recognition Integrating Multisource Geographic Data.

Classification of Urban Functional Zones by Integrating Spatial Features of VHR Satellite Images and Semantic Features of POI Data.

Target Classification of Similar Spatial Characteristics in Complex Urban Areas by Using Multispectral LiDAR

Systematic Comparison of Objects Classification Methods Based on ALS and Optical Remote Sensing Images in Urban Areas

A Method for Classifying Complex Features in Urban Areas Using Video Satellite Remote Sensing Data

The Combined Use of Remote Sensing and Social Sensing Data in Fine-Grained Urban Land Use Mapping: A Case Study in Beijing, China

Sensing Urban with Wi-Fi and Satellite

Urban Area Characterization and Structure Analysis: A Combined Data-Driven Approach by Remote Sensing Information and Spatial-Temporal Wireless Data

An Ensemble Learning Approach for Urban Land Use Mapping Based on Remote Sensing Imagery and Social Sensing Data

Multi-scale multi-temporal landscape pattern analysis using high spatial urban scene classification

Mapping the Time-Series of Essential Urban Land Use Categories in China: A Multi-Source Data Integration Approach

Mapping Global Urban Areas from 2000 to 2012 Using Time-Series Nighttime Light Data and MODIS Products