Abstract:An accurate understanding of urban objects is critical for urban modeling, intelligent infrastructure planning and city management. The semantic segmentation of light detection and ranging (LiDAR) point clouds is a fundamental approach for urban scene analysis. Over the last years, several methods have been developed to segment urban furniture with point clouds. However, the traditional processing of large amounts of spatial data has become increasingly costly, both time-wise and financially. Recently, deep learning (DL) techniques have been increasingly used for 3D segmentation tasks. Yet, most of these deep neural networks (DNNs) were conducted on benchmarks. It is, therefore, arguable whether DL approaches can achieve the state-of-the-art performance of 3D point clouds segmentation in real-life scenarios. In this research, we apply an adapted DNN (ARandLA-Net) to directly process large-scale point clouds. In particular, we develop a new paradigm for training and validation, which presents a typical urban scene in central Europe (Munzingen, Freiburg, Baden-Württemberg, Germany). Our dataset consists of nearly 390 million dense points acquired by Mobile Laser Scanning (MLS), which has a rather larger quantity of sample points in comparison to existing datasets and includes meaningful object categories that are particular to applications for smart cities and urban planning. We further assess the DNN on our dataset and investigate a number of key challenges from varying aspects, such as data preparation strategies, the advantage of color information and the unbalanced class distribution in the real world. The final segmentation model achieved a mean Intersection-over-Union (mIoU) score of 54.4% and an overall accuracy score of 83.9%. Our experiments indicated that different data preparation strategies influenced the model performance. Additional RGB information yielded an approximately 4% higher mIoU score. Our results also demonstrate that the use of weighted cross-entropy with inverse square root frequency loss led to better segmentation performance than when other losses were considered.

Rural road environment segmentation of LiDAR dataset with deep learning

Robust vehicle detection using 3D Lidar under complex urban environment

Graph-based ground segmentation of 3D LIDAR in rough area

Novel Framework for 3D Road Extraction Based on Airborne LiDAR and High-Resolution Remote Sensing Imagery

LASDU: A Large-Scale Aerial LiDAR Dataset for Semantic Labeling in Dense Urban Areas.

Deep Learning for LiDAR-only and LiDAR-fusion 3D Perception: a Survey

On Deep Learning for Geometric and Semantic Scene Understanding Using On-Vehicle 3D LiDAR

Road Environment Semantic Segmentation with Deep Learning from MLS Point Cloud Data

Unsupervised Semantic Segmentation of High-Resolution UAV Imagery for Road Scene Parsing

A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds

Ground-distance Segmentation of 3D LiDAR Point Cloud Toward Autonomous Driving

Unstructured Road Segmentation Based on Road Boundary Enhancement Point-Cylinder Network Using LiDAR Sensor

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

UdeerLID+: Integrating LiDAR, Image, and Relative Depth with Semi-Supervised

An Automatic Road Surface Segmentation in Non-Urban Environments: A 3D Point Cloud Approach With Grid Structure and Shallow Neural Networks

Large-scale Weakly Supervised Learning for Road Extraction from Satellite Imagery

LESA-Net: Semantic segmentation of multi-type road point clouds in complex agroforestry environment

Road-Side Individual Tree Segmentation from Urban MLS Point Clouds Using Metric Learning

Applying Unsupervised Semantic Segmentation to High-Resolution UAV Imagery for Enhanced Road Scene Parsing

A Novel Real-Time Edge-Guided LiDAR Semantic Segmentation Network for Unstructured Environments

Off-Road LiDAR Intensity Based Semantic Segmentation