Abstract:Many recent applications of computer graphics and human computer interaction have adopted both colour cameras and depth cameras as input devices. Therefore, an effective calibration of both types of hardware taking different colour and depth inputs is required. Our approach removes the numerical difficulties of using non-linear optimization in previous methods which explicitly resolve camera intrinsics as well as the transformation between depth and colour cameras. A matrix of hybrid parameters is introduced to linearize our optimization. The hybrid parameters offer a transformation from a depth parametric space (depth camera image) to a colour parametric space (colour camera image) by combining the intrinsic parameters of depth camera and a rotation transformation from depth camera to colour camera. Both the rotation transformation and intrinsic parameters can be explicitly calculated from our hybrid parameters with the help of a standard QR factorisation. We test our algorithm with both synthesized data and real-world data where ground-truth depth information is captured by Microsoft Kinect. The experiments show that our approach can provide comparable accuracy of calibration with the state-of-the-art algorithms while taking much less computation time (1/50 of Herrera’s method and 1/10 of Raposo’s method) due to the advantage of using hybrid parameters.

Calibration of depth cameras using denoised depth images

DoCam: Depth Sensing with an Optical Image Stabilization Supported RGB Camera.

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Depth Map Inpainting Using a Fully Convolutional Network

Guided depth enhancement via a fast marching method

Accurate Intrinsic Calibration Of Depth Camera With Cuboids

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

Depth map enhancement based on color and depth consistency

Guided inpainting and filtering for Kinect depth maps

A non-parametric depth modification model for registration between color and depth images

A Unified Model For Improving Depth Accuracy In Kinect Sensor

3D Feature Points Calibration Method for Depth-Camera

Spatial-temporal depth de-noising for Kinect based on texture edge-assisted depth classification

Real-Time Depth Image Acquisition and Restoration for Image Based Rendering and Processing Systems

Depth-color fusion strategy for 3-D scene modeling with Kinect

A Self-Calibrated Photo-Geometric Depth Camera

Depth Map Reconstruction for Underwater Kinect Camera Using Inpainting and Local Image Mode Filtering

A New Approach to Calibrate Range Image and Color Image from Kinect

Depth Completion Using a View-constrained Deep Prior

A Perceptual Measure for Deep Single Image Camera Calibration

Depth Imaging Denoising of Photon-Counting Lidar.