Abstract:In the field of point cloud representation learning, many self-supervised learning methods aim to address the issue of conventional supervised learning methods relying heavily on labeled data. Particularly in recent years, contrastive learning-based methods have gained an increasing popularity. However, most of the current contrastive learning methods solely rely on conventional random augmentation, limiting the effectiveness of representation learning. Moreover, to prevent model collapse, they construct positive and negative sample pairs or explicit clustering centers, which adds complexity to data preprocessing operations. To address these challenges effectively and achieve accurate point cloud classification and segmentation, we propose PointSL, a self-learning network for point clouds based on contrastive learning. PointSL incorporates a learnable point cloud augmentation (LPA) module, which transforms samples with high precision, significantly improving the augmentation effect. To further enhance feature discrimination, PointSL introduces a self-learning process along a refined feature predictor (FFP). This innovative approach leverages the attention mechanism to facilitate mutual feature prediction between pairs of point clouds, thereby continuously improving discriminant performance. Additionally, the network constructed a simple yet effective self-adaptive loss function that optimizes the entire network through gradient feedback. For pretraining, it is beneficial to obtain encoders with a better generalization and a higher accuracy. We evaluate PointSL on benchmark datasets such as ModelNet40, Sydney Urban Objects and ShapeNetPart. Experimental results demonstrate that PointSL outperforms state-of-the-art self-supervised methods and supervised counterparts, achieving exceptional performance in classification and segmentation tasks. Notably, on the Sydney Urban Objects and ModelNet40 datasets, PointSL achieves OA and AA metrics of 80.6%, 69.9%, 94.2% and 91.4%, respectively. On the ShapeNetPart dataset, PointSL achieves Inst.mIoU and Cls.mIoU metrics of 86.3% and 85.1%, respectively.

Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

A Survey of Label-Efficient Deep Learning for 3D Point Clouds

Classification of LiDAR Point Clouds Using Supervoxel-Based Detrended Feature and Perception-Weighted Graphical Model.

Learning to Optimally Segment Point Clouds

Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation

Clustering based Point Cloud Representation Learning for 3D Analysis

Contrastive Embedding Distribution Refinement and Entropy-Aware Attention for 3D Point Cloud Classification

labelCloud: A Lightweight Domain-Independent Labeling Tool for 3D Object Detection in Point Clouds

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Learning Fine-Grained Segmentation of 3D Shapes without Part Labels

Residual Learning with Annularly Convolutional Neural Networks for Classification and Segmentation of 3D Point Clouds

DAPnet: A Double Self-Attention Convolutional Network for Point Cloud Semantic Labeling

Densify Your Labels: Unsupervised Clustering with Bipartite Matching for Weakly Supervised Point Cloud Segmentation

Self-supervised Point Cloud Representation Learning Via Separating Mixed Shapes

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

ToThePoint: Efficient Contrastive Learning of 3D Point Clouds Via Recycling

ULD-Net: 3D unsupervised learning by dense similarity learning with equivariant-crop

PointMoment:Mixed-Moment-based Self-Supervised Representation Learning for 3D Point Clouds

A point cloud self-learning network based on contrastive learning for classification and segmentation