Abstract:An accurate understanding of urban objects is critical for urban modeling, intelligent infrastructure planning and city management. The semantic segmentation of light detection and ranging (LiDAR) point clouds is a fundamental approach for urban scene analysis. Over the last years, several methods have been developed to segment urban furniture with point clouds. However, the traditional processing of large amounts of spatial data has become increasingly costly, both time-wise and financially. Recently, deep learning (DL) techniques have been increasingly used for 3D segmentation tasks. Yet, most of these deep neural networks (DNNs) were conducted on benchmarks. It is, therefore, arguable whether DL approaches can achieve the state-of-the-art performance of 3D point clouds segmentation in real-life scenarios. In this research, we apply an adapted DNN (ARandLA-Net) to directly process large-scale point clouds. In particular, we develop a new paradigm for training and validation, which presents a typical urban scene in central Europe (Munzingen, Freiburg, Baden-Württemberg, Germany). Our dataset consists of nearly 390 million dense points acquired by Mobile Laser Scanning (MLS), which has a rather larger quantity of sample points in comparison to existing datasets and includes meaningful object categories that are particular to applications for smart cities and urban planning. We further assess the DNN on our dataset and investigate a number of key challenges from varying aspects, such as data preparation strategies, the advantage of color information and the unbalanced class distribution in the real world. The final segmentation model achieved a mean Intersection-over-Union (mIoU) score of 54.4% and an overall accuracy score of 83.9%. Our experiments indicated that different data preparation strategies influenced the model performance. Additional RGB information yielded an approximately 4% higher mIoU score. Our results also demonstrate that the use of weighted cross-entropy with inverse square root frequency loss led to better segmentation performance than when other losses were considered.

MLAE: A Pretraining Method for Automatic Identification of Urban Public Space

Semantic Segmentation for Remote Sensing Based on RGB Images and Lidar Data Using Model-Agnostic Meta-Learning and Partical Swarm Optimization

Evaluation Of Machine Learning-Based Urban Surface Mapping Using A New Moderate-Resolution Satellite Imagery Dataset

Semantic segmentation of deep learning remote sensing images based on band combination principle: Application in urban planning and land use

Fine-Grained Road Scene Understanding from Aerial Images Based on Semisupervised Semantic Segmentation Networks

Land Use Classification Method of Remote Sensing Images for Urban and Rural Planning Monitoring Using Deep Learning

A Method for Extracting Building Information from Remote Sensing Images Based on Deep Learning

Building Precision: Efficient Encoder–Decoder Networks for Remote Sensing Based on Aerial RGB and LiDAR Data

A Novel Hybrid Method for Urban Green Space Segmentation from High-Resolution Remote Sensing Images

Task Specific Pretraining with Noisy Labels for Remote Sensing Image Segmentation

Terrain-Informed Self-Supervised Learning: Enhancing Building Footprint Extraction from LiDAR Data with Limited Annotations

Noisy Supervised Deep Learning for Remote Sensing Image Segmentation Using Electronic Maps

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoders

Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning

Learning Shared RGB-D Fields: Unified Self-supervised Pre-training for Label-efficient LiDAR-Camera 3D Perception

Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery

Research on Self-Supervised Building Information Extraction with High-Resolution Remote Sensing Images for Photovoltaic Potential Evaluation

Identify Urban Area From Remote Sensing Image Using Deep Learning Method

Automatic Labeling to Generate Training Data for Online LiDAR-Based Moving Object Segmentation