Abstract:Although significant improvement has been achieved in fully autonomous driving and semantic high-definition map (HD) domains, most of the existing 3D point cloud segmentation methods cannot provide high representativeness and remarkable robustness. The principally increasing challenges remain in completely and efficiently extracting high-level 3D point cloud features, specifically in large-scale road environments. This paper provides an end-to-end feature extraction framework for 3D point cloud segmentation by using dynamic point-wise convolutional operations in multiple scales. Compared to existing point cloud segmentation methods that are commonly based on traditional convolutional neural networks (CNNs), our proposed method is less sensitive to data distribution and computational powers. This framework mainly includes four modules. Module I is first designed to construct a revised 3D point-wise convolutional operation. Then, a U-shaped downsampling-upsampling architecture is proposed to leverage both global and local features in multiple scales in Module II. Next, in Module III, high-level local edge features in 3D point neighborhoods are further extracted by using an adaptive graph convolutional neural network based on the K-Nearest Neighbor (KNN) algorithm. Finally, in Module IV, a conditional random field (CRF) algorithm is developed for postprocessing and segmentation result refinement. The proposed method was evaluated on three large-scale LiDAR point cloud datasets in both urban and indoor environments. The experimental results acquired by using different point cloud scenarios indicate our method can achieve state-of-the-art semantic segmentation performance in feature representativeness, segmentation accuracy, and technical robustness.

A Novel CNN Architecture for Real-Time Point Cloud Recognition in Road Environment

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

3D LiDAR Map Compression Using Deep Neural Network.

Hybrid CNN-LSTM Architecture for LiDAR Point Clouds Semantic Segmentation

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection

A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Point-Cloud-Based Place Recognition Using CNN Feature Extraction

A Novel Place Recognition Network Using Visual Sequences and LiDAR Point Clouds for Autonomous Vehicles

REAL-TIME SEMANTIC SLAM WITH DCNN-BASED FEATURE POINT DETECTION, MATCHING AND DENSE POINT CLOUD AGGREGATION

Convolution Neural Network Application for Road Asset Detection and Classification in LiDAR Point Cloud

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

3D object recognition method with multiple feature extraction from LiDAR point clouds

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

Efficient Outdoor 3D Point Cloud Semantic Segmentation for Critical Road Objects and Distributed Contexts

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

PLOT: a 3D Point Cloud Object Detection Network for Autonomous Driving.