Abstract:Deep learning techniques for geometric processing have been gaining popularity in recent years, various deep models (i.e., deep learning methods based on neural networks) are developed with enhanced performance and functionality in conventional geometric tasks such as shape classification, segmentation, and recognition. Yet, deep models would rely on large datasets for the training and testing purpose, which are generally lacking as 3D shape geometry could not be easily acquired and/or reconstructed. In this paper, we propose a new 3D shape dataset augmentation method by learning the deformation between shapes in a highly reduced latent space while affording interactive control of shape generation. Specifically, we model each shape using a concise skeleton-based representation, and then we apply Gaussian Process Latent Variable Model (GPLVM) to embed all shape skeletons into a low-dimensional latent space, where new skeletons could be generated with diverse kinds of flexible control and/or quantitative guidance. A second network that learns the displacement between shapes can be employed to produce new 3D shape from newly-generated skeletons. Compared with popular computer vision techniques, our new generative method could overcome remaining challenges of 3D shape augmentation with new characteristics. Specifically, our new method is capable of transforming 3D shapes in a more liberal way, preserving their geometric properties at a semantic level, and creating new shape with ease and flexible control. Extensive experiments have exhibited the capability and flexibility of our new method in generating new shapes using only few samples. Our shape augmentation is an effective way to simultaneously improve the shape creation capability and the shape extrapolation accuracy, and it is also of immediate benefit to almost all deep learning tasks in geometric modeling and processing.

Leveraging Smooth Deformation Augmentation for LiDAR Point Cloud Semantic Segmentation

D-Aug: Enhancing Data Augmentation for Dynamic LiDAR Scenes

Instant Domain Augmentation for LiDAR Semantic Segmentation

LidarAugment: Searching for Scalable 3D LiDAR Data Augmentations

What Can be Seen is What You Get: Structure Aware Point Cloud Augmentation

D-S Augmentation: Density-Semantics Augmentation for 3-D Object Detection

Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weather

Multi‐sensor missile‐borne LiDAR point cloud data augmentation based on Monte Carlo distortion simulation

TauLiM: Test Data Augmentation of LiDAR Point Cloud by Metamorphic Relation

RS-Aug: Improve 3D Object Detection on LiDAR with Realistic Simulator Based Data Augmentation.

Quantifying Data Augmentation for LiDAR based 3D Object Detection

PointAugmenting: Cross-Modal Augmentation for 3D Object Detection

A Transformed-Feature-space Data Augmentation Method for Defect Segmentation.

Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation

Quantitative and Flexible 3D Shape Dataset Augmentation Via Latent Space Embedding and Deformation Learning

TauLiM

Efficient LiDAR Point Cloud Oversegmentation Network

Real3D-Aug: Point Cloud Augmentation by Placing Real Objects with Occlusion Handling for 3D Detection and Segmentation

Joint Semantic Segmentation using representations of LiDAR point clouds and camera images

Improving Radial Imbalances with Hybrid Voxelization and RadialMix for LiDAR 3D Semantic Segmentation

PolarMix: A General Data Augmentation Technique for LiDAR Point Clouds