Abstract:Data representation has been one of the core topics in 3D graphics and pattern recognition in high-dimensional data. Although the high-resolution geometrical information of a physical object can be well preserved in the form of metrical data, e.g., point clouds/triangular meshes, from a regular data (e.g., image/audio) processing perspective, they also bring excessive noise in the course of feature abstraction and regression. For 3D face recognition, preceding attempts focus on treating the scan samples as signals laying on an underlying discrete surface (mesh) or morphable (statistic) models and by embedding auxiliary information, e.g., texture onto the regularized local planar structure to obtain a superior expressive performance to registration-based methods, but environmental variations such as posture/illumination will dissatisfy the integrity or uniform sampling condition, which holistic models generally rely on. In this paper, a geometric deep learning framework for face recognition is proposed, which merely requires the consumption of raw spatial coordinates. The non-uniformity and non-grid geometric transformations in the course of point cloud face scanning are mitigated by modeling each identity as a stochastic process. Individual face scans are considered realizations, yielding underlying inherent distributions under the appropriate assumption of ergodicity. To accomplish 3D facial recognition, we propose a windowed solid harmonic scattering transform on point cloud face scans to extract the invariant coefficients so that unrelated variations can be encoded into certain components of the scattering domain. With these constructions, a sparse learning network as the semi-supervised classification backbone network can work on reducing intraclass variability. Our framework obtained superior performance to current competing methods; without excluding any fragmentary or severely deformed samples, the rank-1 recognition rate (RR1) achieved was 99.84% on the Face Recognition Grand Challenge (FRGC) v2.0 dataset and 99.90% on the Bosphorus dataset.

Low-Dimensional Multi-Modality Representation for 3D Data

An ICA-Based Other-Race Effect Elimination for Facial Expression Recognition.

Deep and Shallow Covariance Feature Quantization for 3D Facial Expression Recognition

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

3D Face Recognition Via Conformal Representation

Robust 3D Face Recognition by Local Shape Difference Boosting

3D Dynamic Facial Expression Recognition Using Low-Resolution Videos

Towards Reading Beyond Faces for Sparsity-aware 3D/4D Affect Recognition

Sparse and Low-rank Tucker Decomposition with Its Application to 2D+3D Facial Expression Recognition

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Learning Locality-Constrained Collaborative Representation for Face Recognition

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Emotion Recognition From Arbitrary View Facial Images

Feature Level Analysis for 3D Facial Expression Recognition.

Sparse Orthogonal Tucker Decomposition for 2D+3D Facial Expression Recognition

A Distribution Independence Based Method for 3D Face Shape Decomposition

Three-Dimensional Face Recognition Using Solid Harmonic Wavelet Scattering and Homotopy Dictionary Learning

Location-sensitive sparse representation of deep normal patterns for expression-robust 3D face recognition

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor