Abstract:Image editing and compositing have become ubiquitous in entertainment, from digital art to AR and VR experiences. To produce beautiful composites, the camera needs to be geometrically calibrated, which can be tedious and requires a physical calibration target. In place of the traditional multi-image calibration process, we propose to infer the camera calibration parameters such as pitch, roll, field of view, and lens distortion directly from a single image using a deep convolutional neural network. We train this network using automatically generated samples from a large-scale panorama dataset, yielding competitive accuracy in terms of standard `2 error. However, we argue that minimizing such standard error metrics might not be optimal for many applications. In this work, we investigate human sensitivity to inaccuracies in geometric camera calibration. To this end, we conduct a large-scale human perception study where we ask participants to judge the realism of 3D objects composited with correct and biased camera calibration parameters. Based on this study, we develop a new perceptual measure for camera calibration and demonstrate that our deep calibration network outperforms previous single-image based calibration methods both on standard metrics as well as on this novel perceptual measure. Finally, we demonstrate the use of our calibration network for several applications, including virtual object insertion, image retrieval, and compositing. A demonstration of our approach is available at <a class="link-external link-https" href="https://lvsn.github.io/deepcalib" rel="external noopener nofollow">this https URL</a> .

GEOMETRIC DEEP LEARNED FEATURE CLASSIFICATION BASED CAMERA CALIBRATION

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Accurate Intrinsic Calibration Of Depth Camera With Cuboids

FEATURE DETECTION AND CORRESPONDENCE FOR CAMERA CALIBRATION

High Precision Calibration Algorithm for Binocular Stereo Vision Camera using Deep Reinforcement Learning

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

A Perceptual Measure for Deep Single Image Camera Calibration

A Deep Perceptual Measure for Lens and Camera Calibration

Deep Learning for Camera Calibration and Beyond: A Survey

CalQNet -- Detection of Calibration Quality for Life-Long Stereo Camera Setups

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Camera Geometric Calibration Using Dynamic Single-Pixel Illumination With Deep Learning Networks

Camera Self-Calibration from Multi-View Images

A Robust Checkerboard Corner Detection Method for Camera Calibration Based on Improved YOLOX

Confidence-based camera calibration with modified census transform

Improved Camera Calibration Method Using Complementary Patterns

Automatic Checkerboard Detection for Camera Calibration Using Self-Correlation.

Degeneracy in Self-Calibration Revisited and a Deep Learning Solution for Uncalibrated SLAM

Self-Supervised Camera Self-Calibration from Video

A New Calibration Technique For Multi-Camera Systems Of Limited Overlapping Field-Of-Views

Geometric-Aware Calibration Mechanism for Self-Supervised Depth Estimation.