Abstract:Previous works have shown that face recognition with high accurate 3D data is more reliable and insensitive to pose and illumination variations. Recently, low-cost and portable 3D acquisition techniques like ToF(Time of Flight) and DoE based structured light systems enable us to access 3D data easily, e.g., via a mobile phone. However, such devices only provide sparse(limited speckles in structured light system) and noisy 3D data which can not support face recognition directly. In this paper, we aim at achieving high-performance face recognition for devices equipped with such modules which is very meaningful in practice as such devices will be very popular. We propose a framework to perform face recognition by fusing a sequence of low-quality 3D data. As 3D data are sparse and noisy which can not be well handled by conventional methods like the ICP algorithm, we design a PointNet-like Deep Registration Network(DRNet) which works with ordered 3D point coordinates while preserving the ability of mining local structures via convolution. Meanwhile we develop a novel loss function to optimize our DRNet based on the quaternion expression which obviously outperforms other widely used functions. For face recognition, we design a deep convolutional network which takes the fused 3D depth-map as input based on AMSoftmax model. Experiments show that our DRNet can achieve rotation error 0.95° and translation error 0.28mm for registration. The face recognition on fused data also achieves rank-1 accuracy 99.2%, FAR-0.001 97.5% on Bosphorus dataset which is comparable with state-of-the-art high-quality data based recognition performance.

Face Recognition on 3D Point Clouds

Data-Free Point Cloud Network for 3D Face Recognition

Point CNN:3D Face Recognition with Local Feature Descriptor and Feature Enhancement Mechanism

Few-Data Guided Learning Upon End-to-End Point Cloud Network for 3D Face Recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

A fast and robust 3D face recognition approach based on deeply learned face representation.

A 3D face recognition method based on corresponding point

A Closer Look at Few-Shot 3D Point Cloud Classification

Deep Learning-Based 3D Face Recognition Using Derived Features from Point Cloud

Face Recognition from Sequential Sparse 3D Data Via Deep Registration.

3Dpc-Net: 3D Point Cloud Network for Face Anti-spoofing.

Learning Directly from Synthetic Point Clouds for "In-the-wild" 3D Face Recognition

An Efficient 3-D Point Cloud Place Recognition Approach Based on Feature Point Extraction and Transformer

Multi-channel Deep 3D Face Recognition

Meta-learning-based Adversarial Training for Deep 3D Face Recognition on Point Clouds

3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network

Cf3d: Category Fused 3d Point Cloud Retrieval

Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

Expression-Robust 3d Face Recognition Based on Feature-Level Fusion and Feature-Region Fusion

DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

3D Face Recognition Based on Facial Profiles