Abstract:Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation has shown promise for point clouds, previous methods mix point clouds either on block level or point level, which has constrained their ability to strike a balance between generating diverse training samples and preserving the local characteristics of point clouds. Additionally, the varying importance of each part of the point clouds has not been fully considered, cause not all parts contribute equally to the classification task, and some parts may contain unimportant or redundant information. To overcome these challenges, we propose PointPatchMix, a novel approach that mixes point clouds at the patch level and integrates a patch scoring module to generate content-based targets for mixed point clouds. Our approach preserves local features at the patch level, while the patch scoring module assigns targets based on the content-based significance score from a pre-trained teacher model. We evaluate PointPatchMix on two benchmark datasets, ModelNet40 and ScanObjectNN, and demonstrate significant improvements over various baselines in both synthetic and real-world datasets, as well as few-shot settings. With Point-MAE as our baseline, our model surpasses previous methods by a significant margin, achieving 86.3% accuracy on ScanObjectNN and 94.1% accuracy on ModelNet40. Furthermore, our approach shows strong generalization across multiple architectures and enhances the robustness of the baseline model.

PointCutMix: Regularization strategy for point cloud classification

PCSalmix: Gradient Saliency-Based Mix Augmentation for Point Cloud Classification

Improving Adversarial Robustness of 3D Point Cloud Classification Models

PointPatchMix: Point Cloud Mixing with Patch Scoring

PointMixup: Augmentation for Point Clouds

FPSMix: data augmentation strategy for point cloud classification

PointManifoldCut: Point-wise Augmentation in the Manifold for Point Clouds

Cosine Mixup: A Mixup Strategy for Point Cloud Contrastive Representation Learning

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

CloudMix: Dual Mixup Consistency for Unpaired Point Cloud Completion

PolarMix: A General Data Augmentation Technique for LiDAR Point Clouds

PointCaM: Cut-and-Mix for Open-Set Point Cloud Learning

Enhancing Robustness to Noise Corruption for Point Cloud Recognition via Spatial Sorting and Set-Mixing Aggregation Module

PatchMixing Masked Autoencoders for 3D Point Cloud Self-Supervised Learning

ResizeMix: Mixing Data with Preserved Object Information and True Labels

HybridPoint: Point Cloud Registration Based on Hybrid Point Sampling and Matching

PointMatch: A Consistency Training Framework for Weakly Supervised Semantic Segmentation of 3D Point Clouds

PointGT: A Method for Point-Cloud Classification and Segmentation Based on Local Geometric Transformation

A Simple and Efficient Point Cloud Sampling Strategy Based on Cluster Merging

HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation Via Hybrid Contrastive Regularization

Push-and-Pull: A General Training Framework with Differential Augmentor for Domain Generalized Point Cloud Classification