Abstract:The semantic segmentation of outdoor LiDAR point clouds is one of the gigantic fields in the large-scale driving scenario. However, the performances of the state-of-the-art methods are unsatisfactory caused by the intrinsic limitations of the outdoor point clouds with excessive distribution of sparsity and imbalanced distribution of density, both of which become great challenges for a precise segmentation of LiDAR point clouds. To tackle the aforementioned intrinsic problems of point clouds with an improved segmentation performance, we propose a brand new attention-based feature interaction module called Voxel Slicing and Interaction based Attention Module (V-SIAM) that is integrated into the segmentation networks. Our V-SIAM is composed of a Voxel Slicing and Interaction Module (V-SIM) followed by a Voxel Attention Module (VAM), where the V-SIM is utilized to significantly reduce the negative impact caused by the imbalanced point density, in terms of enhancing the interaction of the voxel feature by a novel feature slicing, leading to the enriched voxel feature details of the point clouds. Moreover, the VAM is utilized to reduce the negative effect caused by the excessive sparsity of the point clouds, in terms of recalibration among voxel features via an innovative way, leading to the extraction of adaptive and self-enhanced voxel features. Besides the V-SIAM, a Multi-scale Voxel Feature Extractor (MsVFE), utilized as the preprocessing module of the segmentation networks, is proposed to further alleviate the negative influence caused by the excessive sparsity of the point clouds, realized by fusing the multi-scale voxel information of the sparse point clouds, leading to extraction of more detailed features of the point clouds. Our experimental results show that the proposed methods achieve 73.7% mIoU on the large-scale SemanticKITTI benchmark, outperforming the state-of-the-art PVKD and 2DPass by +1.3% mIoU and +0.8% mIoU, respectively. Moreover, our proposed MsVFE and V-SIAM achieve the state-of-the-art performance on the Toronto3D dataset and KITTI-360 dataset.

Improving Radial Imbalances with Hybrid Voxelization and RadialMix for LiDAR 3D Semantic Segmentation

Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Spherical Transformer for LiDAR-based 3D Recognition

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception

Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection

A Preprocessing and Postprocessing Voxel-based Method for LiDAR Semantic Segmentation Improvement in Long Distance

MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Driving

Just Add $100 More: Augmenting NeRF-based Pseudo-LiDAR Point Cloud for Resolving Class-imbalance Problem

RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation

MsVFE and V-SIAM: Attention-based multi-scale feature interaction and fusion for outdoor LiDAR semantic segmentation

Prototype-Voxel Contrastive Learning for LiDAR Point Cloud Panoptic Segmentation

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

VIN: Voxel-based Implicit Network for Joint 3D Object Detection and Segmentation for Lidars

PCB-RandNet: Rethinking Random Sampling for LIDAR Semantic Segmentation in Autonomous Driving Scene

PV-RCNN++: Semantical Point-Voxel Feature Interaction for 3D Object Detection