Abstract:Many recent applications of computer graphics and human computer interaction have adopted both colour cameras and depth cameras as input devices. Therefore, an effective calibration of both types of hardware taking different colour and depth inputs is required. Our approach removes the numerical difficulties of using non-linear optimization in previous methods which explicitly resolve camera intrinsics as well as the transformation between depth and colour cameras. A matrix of hybrid parameters is introduced to linearize our optimization. The hybrid parameters offer a transformation from a depth parametric space (depth camera image) to a colour parametric space (colour camera image) by combining the intrinsic parameters of depth camera and a rotation transformation from depth camera to colour camera. Both the rotation transformation and intrinsic parameters can be explicitly calculated from our hybrid parameters with the help of a standard QR factorisation. We test our algorithm with both synthesized data and real-world data where ground-truth depth information is captured by Microsoft Kinect. The experiments show that our approach can provide comparable accuracy of calibration with the state-of-the-art algorithms while taking much less computation time (1/50 of Herrera’s method and 1/10 of Raposo’s method) due to the advantage of using hybrid parameters.

Intensity-Depth Face Alignment Using Cascade Shape Regression

Cascade of Forests for Face Alignment

Human face detection under weak light based on depth information

Depth map enhancement based on color and depth consistency

Adaptive Cascade Regression Model for Robust Face Alignment.

Facial Depth Map Enhancement Via Neighbor Embedding.

Cascaded face alignment via intimacy definition feature

Dual Sparse Constrained Cascade Regression for Robust Face Alignment.

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

Cascaded Deep Convolutional Neural Network for Robust Face Alignment.

Depth-Based 3D Face Reconstruction and Pose Estimation Using Shape-Preserving Domain Adaptation

Depth incorporating with color improves salient object detection

Improved Face Detection and Alignment using Cascade Deep Convolutional Network

Deep Entwined Learning Head Pose and Face Alignment Inside an Attentional Cascade with Doubly-Conditional fusion

Depth-color fusion strategy for 3-D scene modeling with Kinect

Robust 3D Reconstruction with an RGB-D Camera

Face Alignment with Two-Layer Shape Regression

A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal Features

Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks

Joint Learning for Face Alignment and Face Transfer with Depth Image

On 3D Face Reconstruction via Cascaded Regression in Shape Space