Abstract:Data representation has been one of the core topics in 3D graphics and pattern recognition in high-dimensional data. Although the high-resolution geometrical information of a physical object can be well preserved in the form of metrical data, e.g., point clouds/triangular meshes, from a regular data (e.g., image/audio) processing perspective, they also bring excessive noise in the course of feature abstraction and regression. For 3D face recognition, preceding attempts focus on treating the scan samples as signals laying on an underlying discrete surface (mesh) or morphable (statistic) models and by embedding auxiliary information, e.g., texture onto the regularized local planar structure to obtain a superior expressive performance to registration-based methods, but environmental variations such as posture/illumination will dissatisfy the integrity or uniform sampling condition, which holistic models generally rely on. In this paper, a geometric deep learning framework for face recognition is proposed, which merely requires the consumption of raw spatial coordinates. The non-uniformity and non-grid geometric transformations in the course of point cloud face scanning are mitigated by modeling each identity as a stochastic process. Individual face scans are considered realizations, yielding underlying inherent distributions under the appropriate assumption of ergodicity. To accomplish 3D facial recognition, we propose a windowed solid harmonic scattering transform on point cloud face scans to extract the invariant coefficients so that unrelated variations can be encoded into certain components of the scattering domain. With these constructions, a sparse learning network as the semi-supervised classification backbone network can work on reducing intraclass variability. Our framework obtained superior performance to current competing methods; without excluding any fragmentary or severely deformed samples, the rank-1 recognition rate (RR1) achieved was 99.84% on the Face Recognition Grand Challenge (FRGC) v2.0 dataset and 99.90% on the Bosphorus dataset.

Meta-learning-based Adversarial Training for Deep 3D Face Recognition on Point Clouds

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Improving Adversarial Robustness of 3D Point Cloud Classification Models

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Few-Data Guided Learning Upon End-to-End Point Cloud Network for 3D Face Recognition

3D Meta-Registration: Learning to Learn Registration of 3D Point Clouds

Data-Free Point Cloud Network for 3D Face Recognition

Deep Learning-Based 3D Face Recognition Using Derived Features from Point Cloud

3D Meta-Segmentation Neural Network

Masked Local-Global Representation Learning for 3D Point Cloud Domain Adaptation

Robust 3D Face Recognition by Local Shape Difference Boosting

Is it “Every Man’s Right to Have Babies If He Wants Them”?: Male Pregnancy and the Limits of Reproductive Liberty

Towards Effective Adversarial Textured 3D Meshes on Physical Face Recognition

Few-Shot Meta-Learning on Point Cloud for Semantic Segmentation

Face3DAdv: Exploiting Robust Adversarial 3D Patches on Physical Face Recognition

Dual-Branch Meta-Learning Network With Distribution Alignment for Face Anti-Spoofing

Application of Meta Learning in Face Recognition

Multi-channel Deep 3D Face Recognition

Extending Adversarial Attacks and Defenses to Deep 3D Point Cloud Classifiers

Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning

Three-Dimensional Face Recognition Using Solid Harmonic Wavelet Scattering and Homotopy Dictionary Learning