Abstract:An accurate understanding of urban objects is critical for urban modeling, intelligent infrastructure planning and city management. The semantic segmentation of light detection and ranging (LiDAR) point clouds is a fundamental approach for urban scene analysis. Over the last years, several methods have been developed to segment urban furniture with point clouds. However, the traditional processing of large amounts of spatial data has become increasingly costly, both time-wise and financially. Recently, deep learning (DL) techniques have been increasingly used for 3D segmentation tasks. Yet, most of these deep neural networks (DNNs) were conducted on benchmarks. It is, therefore, arguable whether DL approaches can achieve the state-of-the-art performance of 3D point clouds segmentation in real-life scenarios. In this research, we apply an adapted DNN (ARandLA-Net) to directly process large-scale point clouds. In particular, we develop a new paradigm for training and validation, which presents a typical urban scene in central Europe (Munzingen, Freiburg, Baden-Württemberg, Germany). Our dataset consists of nearly 390 million dense points acquired by Mobile Laser Scanning (MLS), which has a rather larger quantity of sample points in comparison to existing datasets and includes meaningful object categories that are particular to applications for smart cities and urban planning. We further assess the DNN on our dataset and investigate a number of key challenges from varying aspects, such as data preparation strategies, the advantage of color information and the unbalanced class distribution in the real world. The final segmentation model achieved a mean Intersection-over-Union (mIoU) score of 54.4% and an overall accuracy score of 83.9%. Our experiments indicated that different data preparation strategies influenced the model performance. Additional RGB information yielded an approximately 4% higher mIoU score. Our results also demonstrate that the use of weighted cross-entropy with inverse square root frequency loss led to better segmentation performance than when other losses were considered.

Semantic Segmentation Method for Road Intersection Point Clouds Based on Lightweight LiDAR

Multi-Feature Aggregation for Semantic Segmentation of an Urban Scene Point Cloud

RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

Semantic Segmentation and Roof Reconstruction of Urban Buildings Based on LiDAR Point Clouds

Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling.

Building Extraction from LiDAR Point Clouds Based on Revised RandLA-Net

A semantic segmentation method for vehicle‐borne laser scanning point clouds in motorway scenes

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

Framework for Geometric Information Extraction and Digital Modeling from LiDAR Data of Road Scenarios.

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

3D Point Cloud Semantic Segmentation Toward Large-Scale Unstructured Agricultural Scene Classification

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

PCB-RandNet: Rethinking Random Sampling for LIDAR Semantic Segmentation in Autonomous Driving Scene

Road-Side Individual Tree Segmentation from Urban MLS Point Clouds Using Metric Learning

RailSeg: Learning Local–Global Feature Aggregation With Contextual Information for Railway Point Cloud Semantic Segmentation

Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

Hierarchical Semantic Segmentation of Urban Scene Point Clouds Via Group Proposal and Graph Attention Network

A Fast Ground Segmentation Method of LiDAR Point Cloud from Coarse-to-Fine