Abstract:Although significant improvement has been achieved in fully autonomous driving and semantic high-definition map (HD) domains, most of the existing 3D point cloud segmentation methods cannot provide high representativeness and remarkable robustness. The principally increasing challenges remain in completely and efficiently extracting high-level 3D point cloud features, specifically in large-scale road environments. This paper provides an end-to-end feature extraction framework for 3D point cloud segmentation by using dynamic point-wise convolutional operations in multiple scales. Compared to existing point cloud segmentation methods that are commonly based on traditional convolutional neural networks (CNNs), our proposed method is less sensitive to data distribution and computational powers. This framework mainly includes four modules. Module I is first designed to construct a revised 3D point-wise convolutional operation. Then, a U-shaped downsampling-upsampling architecture is proposed to leverage both global and local features in multiple scales in Module II. Next, in Module III, high-level local edge features in 3D point neighborhoods are further extracted by using an adaptive graph convolutional neural network based on the K-Nearest Neighbor (KNN) algorithm. Finally, in Module IV, a conditional random field (CRF) algorithm is developed for postprocessing and segmentation result refinement. The proposed method was evaluated on three large-scale LiDAR point cloud datasets in both urban and indoor environments. The experimental results acquired by using different point cloud scenarios indicate our method can achieve state-of-the-art semantic segmentation performance in feature representativeness, segmentation accuracy, and technical robustness.

Scene Understanding in a Large Dynamic Environment Through a Laser-Based Sensing.

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

Robust vehicle detection using 3D Lidar under complex urban environment

Map building for indoor environment with laser range scanner

Segmentation and classification of range image from an intelligent vehicle in urban environment

Computing Object-Based Saliency in Urban Scenes Using Laser Sensing

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Urban Scene Segmentation with Laser-Constrained CRFs

SLAM in a dynamic large outdoor environment using a laser scanner

Moving Object Classification Using Horizontal Laser Scan Data

Active Scene Understanding via Online Semantic Reconstruction

Large-Scale 3D Semantic Mapping Using Monocular Vision

A Fast and Accurate Segmentation Method for Ordered LiDAR Point Cloud of Large-Scale Scenes

Combining Laser-Scanning Data and Images for Target Tracking and Scene Modeling

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Deep Learning-Based Classification and Reconstruction of Residential Scenes From Large-Scale Point Clouds.

A Fully Online and Unsupervised System for Large and High-Density Area Surveillance

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

A fully online and unsupervised system for large and high-density area surveillance: Tracking, semantic scene learning and abnormality detection

Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame