Abstract:The semantic segmentation of light detection and ranging (LiDAR) point clouds plays an important role in 3-D scene intelligent perception and semantic modeling. The unstructured, sparse and uneven characteristics of point clouds pose great challenges to the representation of the local geometric shapes, which degrades semantic segmentation performance. To address the challenges of describing local geometric shapes due to unstructured and sparse 3-D point clouds, this article proposes a category-contrastive-guided graph convolutional network (CGGC-Net) for the semantic segmentation of LiDAR point clouds. First, a detailed geometric structure of the raw point clouds is encoded to represent the inherent geometric pattern within the local neighborhood. At the same time, the geometric structures information is transmitted across multiple layers, so that the geometric structure encoding information containing different receptive fields and richer neighborhood spatial structure can be aggregated. Following this, the graph convolution neural network uses the edge convolution layer to adaptively describe the semantic correlation between the query point and its neighboring points, and combines the attention mechanism to gather the surrounding feature information to the query point. As a result, the graph convolution neural network and attention mechanism are iteratively stacked for the aggregation and fusion of spatial context semantic information, to generate highly discriminative semantic feature representation. Finally, the superparameters of the model are learned through a multitask optimization strategy guided by category-aware contrastive loss and cross-entropy loss. Experiments are conducted on the public SemanticKITTI dataset and the Stanford large-scale 3-D Indoor Spaces dataset to demonstrate the effectiveness and reliability of the proposed CGGC-Net from both quantitative and qualitative perspectives. The results indicate its capability of automatically classifying LiDAR point clouds, with a mean intersection-over-union of 58.4%. Moreover, multiple comparative experiments also demonstrate the superior performance of the proposed method, exceeding state-of-the-art methods.

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

Hybrid CNN-LSTM Architecture for LiDAR Point Clouds Semantic Segmentation

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

Multilevel intuitive attention neural network for airborne LiDAR point cloud semantic segmentation

Point Attention Network for Semantic Segmentation of 3D Point Clouds

A Semantic-Assisted LiDAR SLAM Based on Attention Feature Points

Semantic Segmentation of LiDAR Point Cloud Based on CAFF-PointNet

Fast Context-Awareness Encoder for LiDAR Point Semantic Segmentation

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

Multi-modal LiDAR Point Cloud Semantic Segmentation with Salience Refinement and Boundary Perception

DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

A Category-Contrastive Guided-Graph Convolutional Network Approach for the Semantic Segmentation of Point Clouds

Enhanced Local Feature Learning with Simple Offset Attention for Semantic Segmentation of Large-scale Point Clouds

Flexible asymmetric convolutional attention network for LiDAR semantic

Improving performance of deep learning models for 3D point cloud semantic segmentation via attention mechanisms

Ground-Aware Point Cloud Semantic Segmentation for Autonomous Driving

Point Attention Network for Point Cloud Semantic Segmentation.

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

Large-scale point cloud semantic segmentation via local perception and global descriptor vector