Abstract:An accurate understanding of urban objects is critical for urban modeling, intelligent infrastructure planning and city management. The semantic segmentation of light detection and ranging (LiDAR) point clouds is a fundamental approach for urban scene analysis. Over the last years, several methods have been developed to segment urban furniture with point clouds. However, the traditional processing of large amounts of spatial data has become increasingly costly, both time-wise and financially. Recently, deep learning (DL) techniques have been increasingly used for 3D segmentation tasks. Yet, most of these deep neural networks (DNNs) were conducted on benchmarks. It is, therefore, arguable whether DL approaches can achieve the state-of-the-art performance of 3D point clouds segmentation in real-life scenarios. In this research, we apply an adapted DNN (ARandLA-Net) to directly process large-scale point clouds. In particular, we develop a new paradigm for training and validation, which presents a typical urban scene in central Europe (Munzingen, Freiburg, Baden-Württemberg, Germany). Our dataset consists of nearly 390 million dense points acquired by Mobile Laser Scanning (MLS), which has a rather larger quantity of sample points in comparison to existing datasets and includes meaningful object categories that are particular to applications for smart cities and urban planning. We further assess the DNN on our dataset and investigate a number of key challenges from varying aspects, such as data preparation strategies, the advantage of color information and the unbalanced class distribution in the real world. The final segmentation model achieved a mean Intersection-over-Union (mIoU) score of 54.4% and an overall accuracy score of 83.9%. Our experiments indicated that different data preparation strategies influenced the model performance. Additional RGB information yielded an approximately 4% higher mIoU score. Our results also demonstrate that the use of weighted cross-entropy with inverse square root frequency loss led to better segmentation performance than when other losses were considered.

Incorporating Human Domain Knowledge in 3D LiDAR-based Semantic Segmentation.

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Semantic Segmentation of 3D LiDAR Data in Dynamic Scene Using Semi-Supervised Learning

Adapting projection-based LiDAR semantic segmentation to natural domains

Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Hierarchical Insights: Exploiting Structural Similarities for Reliable 3D Semantic Segmentation

Rethinking 3D LiDAR Point Cloud Segmentation

Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving

Domain generalization of 3D semantic segmentation in autonomous driving

LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection

Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

Semantic Segmentation for Full-Waveform LiDAR Data Using Local and Hierarchical Global Feature Extraction

Lidar Annotation Is All You Need

Multispectral LiDAR Point Cloud Segmentation for Land Cover Leveraging Semantic Fusion in Deep Learning Network

Self-Supervised Drivable Area Segmentation Using LiDAR's Depth Information for Autonomous Driving

Incorporating DeepLabv3+and Object-Based Image Analysis for Semantic Segmentation of Very High Resolution Remote Sensing Images

A Multi-View-Assisted Semantic Segmentation Network on LiDAR Via Multi-Level Mutual Learning Knowledge Distillation

Learning 3D Semantic Segmentation with only 2D Image Supervision

Pseudo Multi-Modal Approach to LiDAR Semantic Segmentation

Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data