Abstract:Although significant improvement has been achieved in fully autonomous driving and semantic high-definition map (HD) domains, most of the existing 3D point cloud segmentation methods cannot provide high representativeness and remarkable robustness. The principally increasing challenges remain in completely and efficiently extracting high-level 3D point cloud features, specifically in large-scale road environments. This paper provides an end-to-end feature extraction framework for 3D point cloud segmentation by using dynamic point-wise convolutional operations in multiple scales. Compared to existing point cloud segmentation methods that are commonly based on traditional convolutional neural networks (CNNs), our proposed method is less sensitive to data distribution and computational powers. This framework mainly includes four modules. Module I is first designed to construct a revised 3D point-wise convolutional operation. Then, a U-shaped downsampling-upsampling architecture is proposed to leverage both global and local features in multiple scales in Module II. Next, in Module III, high-level local edge features in 3D point neighborhoods are further extracted by using an adaptive graph convolutional neural network based on the K-Nearest Neighbor (KNN) algorithm. Finally, in Module IV, a conditional random field (CRF) algorithm is developed for postprocessing and segmentation result refinement. The proposed method was evaluated on three large-scale LiDAR point cloud datasets in both urban and indoor environments. The experimental results acquired by using different point cloud scenarios indicate our method can achieve state-of-the-art semantic segmentation performance in feature representativeness, segmentation accuracy, and technical robustness.

Efficient Multi-scale Plane Extraction Based RGBD Video Segmentation

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Automatic Extraction of Video Object Plane by Integrating Spatio-Temporal Information

RGB-D Video Segmentation via Geodesic Spatio-Temporal Propagation

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Object Detection and Tracking under Occlusion for Object-Level RGB-D Video Segmentation

Non-rigid Video Object Segmentation Based on Semantic Multi-level Framework.

Joining Geometric and RGB Features for RGB-D Semantic Segmentation

PlaneSeg: Building a Plug-In for Boosting Planar Region Segmentation

RGB-D image segmentation using superpixel and multi-feature fusion graph theory

PlaneSegNet: Fast and Robust Plane Estimation Using a Single-stage Instance Segmentation CNN

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

Point cloud segmentation based on Euclidean clustering and multi-plane extraction in rugged field

Weakly-Supervised RGBD Video Object Segmentation

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

Hierarchical Deep Co-segmentation of Primary Objects in Aerial Videos

Interactive RGB-D Image Segmentation Using Hierarchical Graph Cut and Geodesic Distance

RGB-D Video Object Segmentation Via Enhanced Multi-store Feature Memory