Abstract:The semantic segmentation of outdoor LiDAR point clouds is one of the gigantic fields in the large-scale driving scenario. However, the performances of the state-of-the-art methods are unsatisfactory caused by the intrinsic limitations of the outdoor point clouds with excessive distribution of sparsity and imbalanced distribution of density, both of which become great challenges for a precise segmentation of LiDAR point clouds. To tackle the aforementioned intrinsic problems of point clouds with an improved segmentation performance, we propose a brand new attention-based feature interaction module called Voxel Slicing and Interaction based Attention Module (V-SIAM) that is integrated into the segmentation networks. Our V-SIAM is composed of a Voxel Slicing and Interaction Module (V-SIM) followed by a Voxel Attention Module (VAM), where the V-SIM is utilized to significantly reduce the negative impact caused by the imbalanced point density, in terms of enhancing the interaction of the voxel feature by a novel feature slicing, leading to the enriched voxel feature details of the point clouds. Moreover, the VAM is utilized to reduce the negative effect caused by the excessive sparsity of the point clouds, in terms of recalibration among voxel features via an innovative way, leading to the extraction of adaptive and self-enhanced voxel features. Besides the V-SIAM, a Multi-scale Voxel Feature Extractor (MsVFE), utilized as the preprocessing module of the segmentation networks, is proposed to further alleviate the negative influence caused by the excessive sparsity of the point clouds, realized by fusing the multi-scale voxel information of the sparse point clouds, leading to extraction of more detailed features of the point clouds. Our experimental results show that the proposed methods achieve 73.7% mIoU on the large-scale SemanticKITTI benchmark, outperforming the state-of-the-art PVKD and 2DPass by +1.3% mIoU and +0.8% mIoU, respectively. Moreover, our proposed MsVFE and V-SIAM achieve the state-of-the-art performance on the Toronto3D dataset and KITTI-360 dataset.

VIASEG: Visual Information Assisted Lightweight Point Cloud Segmentation.

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Point and Voxel Cross Perception with Lightweight Cosformer for Large-Scale Point Cloud Semantic Segmentation

Multi-Scale Depthwise Separable Convolution for Semantic Segmentation in Street–Road Scenes

SVASeg: Sparse Voxel-Based Attention for 3D LiDAR Point Cloud Semantic Segmentation.

Large-scale point cloud semantic segmentation via local perception and global descriptor vector

Accurate 3-D Semantic Segmentation of Point Clouds for Intelligent Vehicles Based on Multiview Edge Guidance and Fusion

MSSINet: Real-Time Segmentation Based on Multi-Scale Strip Integration

A Lightweight Network for Fast Semantic Segmentation.

Local-to-Global Perception Network for Point Cloud Segmentation

Accurate 3D Semantic Segmentation of Point Clouds for Intelligent Vehicles Based on Multi-view Edge Guidance and Fusion

Light-Deeplabv3+: a lightweight real-time semantic segmentation method for complex environment perception

MsVFE and V-SIAM: Attention-based multi-scale feature interaction and fusion for outdoor LiDAR semantic segmentation

LightSeg: a Light-Weight Network for Real-Time Semantic Segmentation

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

PointSeg: Real-Time Semantic Segmentation Based on 3D LiDAR Point Cloud

MS-RRFSegNet: Multiscale Regional Relation Feature Segmentation Network for Semantic Segmentation of Urban Scene Point Clouds.

VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation