Abstract:Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation has shown promise for point clouds, previous methods mix point clouds either on block level or point level, which has constrained their ability to strike a balance between generating diverse training samples and preserving the local characteristics of point clouds. Additionally, the varying importance of each part of the point clouds has not been fully considered, cause not all parts contribute equally to the classification task, and some parts may contain unimportant or redundant information. To overcome these challenges, we propose PointPatchMix, a novel approach that mixes point clouds at the patch level and integrates a patch scoring module to generate content-based targets for mixed point clouds. Our approach preserves local features at the patch level, while the patch scoring module assigns targets based on the content-based significance score from a pre-trained teacher model. We evaluate PointPatchMix on two benchmark datasets, ModelNet40 and ScanObjectNN, and demonstrate significant improvements over various baselines in both synthetic and real-world datasets, as well as few-shot settings. With Point-MAE as our baseline, our model surpasses previous methods by a significant margin, achieving 86.3% accuracy on ScanObjectNN and 94.1% accuracy on ModelNet40. Furthermore, our approach shows strong generalization across multiple architectures and enhances the robustness of the baseline model.

Patch Mix Augmentation with Dual Encoders for Meta-Learning

Patch Mix Augmentation with Dual Encoders for Meta-Learning.

MetaAugment: Sample-Aware Data Augmentation Policy Learning

MetAug: Contrastive Learning via Meta Feature Augmentation

WeMix: How to Better Utilize Data Augmentation

Prototype Augmentation with Dummy Samples.

PatchMix: patch-level mixup for data augmentation in convolutional neural networks

Dual Meta Calibration Mix for Improving Generalization in Meta-Learning

TransformMix: Learning Transformation and Mixing Strategies from Data

MixGen: A New Multi-Modal Data Augmentation

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

Evolving Image Compositions for Feature Representation Learning

FeaMix: Feature Mix with Memory Batch Based on Self-Consistency Learning for Code Generation and Code Translation

MetaMixUp: Learning Adaptive Interpolation Policy of MixUp with Meta-Learning

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

Automatic Data Augmentation by Learning the Deterministic Policy

A Good Data Augmentation Policy Is Not All You Need: A Multi-Task Learning Perspective

Meta-Learning Requires Meta-Augmentation

AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation

Task Augmentation by Rotating for Meta-Learning

PointPatchMix: Point Cloud Mixing with Patch Scoring