Abstract:The semantic segmentation of light detection and ranging (LiDAR) point clouds plays an important role in 3-D scene intelligent perception and semantic modeling. The unstructured, sparse and uneven characteristics of point clouds pose great challenges to the representation of the local geometric shapes, which degrades semantic segmentation performance. To address the challenges of describing local geometric shapes due to unstructured and sparse 3-D point clouds, this article proposes a category-contrastive-guided graph convolutional network (CGGC-Net) for the semantic segmentation of LiDAR point clouds. First, a detailed geometric structure of the raw point clouds is encoded to represent the inherent geometric pattern within the local neighborhood. At the same time, the geometric structures information is transmitted across multiple layers, so that the geometric structure encoding information containing different receptive fields and richer neighborhood spatial structure can be aggregated. Following this, the graph convolution neural network uses the edge convolution layer to adaptively describe the semantic correlation between the query point and its neighboring points, and combines the attention mechanism to gather the surrounding feature information to the query point. As a result, the graph convolution neural network and attention mechanism are iteratively stacked for the aggregation and fusion of spatial context semantic information, to generate highly discriminative semantic feature representation. Finally, the superparameters of the model are learned through a multitask optimization strategy guided by category-aware contrastive loss and cross-entropy loss. Experiments are conducted on the public SemanticKITTI dataset and the Stanford large-scale 3-D Indoor Spaces dataset to demonstrate the effectiveness and reliability of the proposed CGGC-Net from both quantitative and qualitative perspectives. The results indicate its capability of automatically classifying LiDAR point clouds, with a mean intersection-over-union of 58.4%. Moreover, multiple comparative experiments also demonstrate the superior performance of the proposed method, exceeding state-of-the-art methods.

Improving CNN-based Semantic Segmentation on Structurally Similar Data Using Contrastive Graph Convolutional Networks

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

An Attention Enhanced Graph Convolutional Network for Semantic Segmentation

Dual Graph Convolutional Network for Semantic Segmentation.

CNN-G: Convolutional Neural Network Combined With Graph for Image Segmentation With Theoretical Analysis

Class-related Graph Convolution for Weakly Supervised Semantic Segmentation

FGCN: Image-Fused Point Cloud Semantic Segmentation with Fusion Graph Convolutional Network

Edge-Enhanced GCIFFNet: A Multiclass Semantic Segmentation Network Based on Edge Enhancement and Multiscale Attention Mechanism

A Category-Contrastive Guided-Graph Convolutional Network Approach for the Semantic Segmentation of Point Clouds

Edge Enhancement Oriented Graph Convolutional Networks for Point Cloud Segmentation

Three-Dimensional Point Cloud Semantic Segmentation Network Based on Spatial Graph Convolution Network

Graph-Boosted Convolutional Neural Networks For Semantic Segmentation

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

Densely connected graph convolutional network for joint semantic and instance segmentation of indoor point clouds

Class Semantic Enhancement Network for Semantic Segmentation

A Top-Down Manner-Based DCNN Architecture for Semantic Image Segmentation.

Exploring Cross-Image Pixel Contrast for Semantic Segmentation

Region-aware Contrastive Learning for Semantic Segmentation

2 Related Work Following the success of deep neural networks for image classification

DECNet: Dense embedding contrast for unsupervised semantic segmentation