Abstract:State-of-the-art methods for driving-scene LiDAR-based perception (including point cloud semantic segmentation, panoptic segmentation and 3D detection, etc.) often project the point clouds to 2D space and then process them via 2D convolution. Although this cooperation shows the competitiveness in the point cloud, it inevitably alters and abandons the 3D topology and geometric relations. A natural remedy is to utilize the 3D voxelization and 3D convolution network. However, we found that in the outdoor point cloud, the improvement obtained in this way is quite limited. An important reason is the property of the outdoor point cloud, namely sparsity and varying density. Motivated by this investigation, we propose a new framework for the outdoor LiDAR segmentation, where cylindrical partition and asymmetrical 3D convolution networks are designed to explore the 3D geometric pattern while maintaining these inherent properties. The proposed model acts as a backbone and the learned features from this model can be used for downstream tasks such as point cloud semantic and panoptic segmentation or 3D detection. In this paper, we benchmark our model on these three tasks. For semantic segmentation, we evaluate the proposed model on several large-scale datasets, i.e., SemanticKITTI, nuScenes and A2D2. Our method achieves the state-of-the-art on the leaderboard of SemanticKITTI (both single-scan and multi-scan challenge), and significantly outperforms existing methods on nuScenes and A2D2 dataset. Furthermore, the proposed 3D framework also shows strong performance and good generalization on LiDAR panoptic segmentation and LiDAR 3D detection.

CIRCLE: Convolutional Implicit Reconstruction and Completion for Large-Scale Indoor Scene

Up-to-Down Network: Fusing Multi-Scale Context for 3D Semantic Scene Completion

Behind the Veil: Enhanced Indoor 3D Scene Reconstruction with Occluded Surfaces Completion

I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing Via Raytracing in Neural SDFs

Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception

3D Reconstruction of Indoor Scenes Via Image Registration

Efficient Implicit Neural Reconstruction Using LiDAR

Fine-detailed Neural Indoor Scene Reconstruction using multi-level importance sampling and multi-view consistency

OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctrees

SDC: Spatial Depth Completion for Outdoor Scenes

Semantic Scene Completion Through Multi-Level Feature Fusion

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation

Point Cloud Completion Via Self-projected View Augmentation and Implicit Field Constraint

O$^2$-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model

Semantic Scene Completion via Integrating Instances and Scene in-the-Loop

Voxel- and Bird's-Eye-View-Based Semantic Scene Completion for LiDAR Point Clouds

Semi-supervised Implicit Scene Completion from Sparse LiDAR