Abstract:In this paper we propose a robust face recognition algorithm for low resolution RGB-D Kinect data. Many techniques are proposed for image preprocessing due to the noisy depth data. First, facial symmetry is exploited based on the 3D point cloud to obtain a canonical frontal view image irrespective of the initial pose and then depth data is converted to XYZ normal maps. Secondly, multi-channel Discriminant Transforms are then used to project RGB to DCS (Discriminant Color Space) and normal maps to DNM (Discriminant Normal Maps). Finally, a Multi-channel Robust Sparse Coding method is proposed that codes the multiple channels (DCS or DNM) of a test image as a sparse combination of training samples with different pixel weighting. Weights are calculated dynamically in an iterative process to achieve robustness against variations in pose, illumination, facial expressions and disguise. In contrast to existing techniques, our multi-channel approach is more robust to variations. Reconstruction errors of the test image (DCS and DNM) are normalized and fused to decide its identity. The proposed algorithm is evaluated on four public databases. It achieves 98.4% identification rate on CurtinFaces, a Kinect database with 4784 RGB-D images of 52 subjects. Using a first versus all protocol on the Bosphorus, CASIA and FRGC v2 databases, the proposed algorithm achieves 97.6%, 95.6% and 95.2% identification rates respectively. To the best of our knowledge, these are the highest identification rates reported so far for the first three databases.

Improving RGB-D Face Recognition via Transfer Learning from a Pretrained 2D Network.

End-to-End Spatial Transform Face Detection and Recognition

Confidence-Aware RGB-D Face Recognition Via Virtual Depth Synthesis

High-Accuracy RGB-D Face Recognition via Segmentation-Aware Face Depth Estimation and Mask-Guided Attention Network

Improved RGB-D-T Based Face Recognition.

Robust 3D Face Recognition by Local Shape Difference Boosting

Exploiting Enhanced and Robust RGB-D Face Representation Via Progressive Multi-Modal Learning

Improving 2D face recognition via fine-level facial depth generation and RGB-D complementary feature learning

3D Face Recognition Method Based on Deep Convolutional Neural Network

Depth CNNs for RGB-D scene recognition: learning from scratch better than transferring from RGB-CNNs

RGB-D Object Recognition Via Incorporating Latent Data Structure and Prior Knowledge

Two-Level Attention-based Fusion Learning for RGB-D Face Recognition

A Complementary Fusion Strategy for RGB-D Face Recognition

Utilizing Relevant RGB–D Data to Help Recognize RGB Images in the Target Domain

Convolutional Neural Network for 3D Object Recognition Based on RGB-D Dataset

Deep transfer network for face recognition using 3D synthesized face

Rgb-D Object Recognition Using The Knowledge Transferred From Relevant Rgb Images

Discriminant Patch Representation for RGB-D Face Recognition Using Convolutional Neural Networks

Convolution-Based Encoding of Depth Images for Transfer Learning in RGB-D Scene Classification

Semi-supervised Learning for RGB-D Object Recognition.

Robust RGB-D Face Recognition Using Kinect Sensor.