Abstract:Existing projector-camera calibration methods typically warp keypoints from a camera image to a projector image using estimated homographies and often suffer from errors in camera parameters and noises due to imperfect planarity of the calibration target. This article proposes a practical and robust projector-camera calibration system that explicitly deals with these challenges. First, a graph-theory-based correspondence algorithm is built on top of a color-coded spatial structured light (SL) pattern. Such SL correspondences are then used for a coarse projector-camera calibration. To gain more robustness against noises from an imperfect planar calibration board, we develop a bundle adjustment algorithm to jointly optimize the estimated projector-camera parameters and the correspondences' coordinates. Moreover, our system requires only one shot of an SL pattern for each calibration board pose, which is much more practical than multishot solutions. Comprehensive experimental validation is conducted on both synthetic and real data sets, and our method clearly outperforms the existing methods in all experiments. For the benefit of the society, a practical open-source software with graphical user interface (GUI) of the developed system is publicly available at https://github.com/bingyaohuang/single-shot-pro-cam-calib. Note to Practitioners—The proposed method is motivated by two challenges in industrial structured light (SL) system calibration: 1) robustness against imperfect planarity of the calibration target and 2) the number of SL projections per pose. In many industrial SL-based 3-D reconstruction systems, the calibration accuracy greatly affects the reconstruction reliability. Our SL calibration system explicitly deals with calibration target's imperfect planarity and thus outperforms the existing methods in terms of system accuracy. Another advantage of our-SL calibration system is single-shot-per-pose, allowing fast recalibration and reducing the decoding error due to slight pattern misalignment in multishot methods [37]. In addition, we release the open-source calibration software with a graphical user interface (GUI), with which calibration and sparse 3-D reconstruction can be easily performed without any further instructions. Moreover, considering the complex calibration environment and setup, we make the camera and projector imaging parameters, such as exposure, brightness, and contrast, adjustable through widgets and preview. Finally, a limitation of our color-coded SL system is its sensitivity to environment lighting and target texture. This problem may be solved by projector photometric compensation [16], [18], [19], [39].

A Omni-Directional Inter-Camer Color Calibration

High Quality Color Calibration for Multi-Camera Systems with an Omnidirectional Color Checker

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Calibration of Central Omnidirectional Cameras Via the Viewing Sphere

Calibration of a Camera-Array-based Microscopic System with Spatiotemporal Structured Light Encoding

Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Collaborative Color Calibration for Multi-Camera Systems

Centra Catadioptric Camera Calibration with Single Image.

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

An adaptive calibration algorithm for projected images in daily environment.

Mobile Camera Array Calibration for Light Field Acquisition

A Novel Camera Calibration Method Based on Multiple Calibration Planes

A High-Quality and Convenient Camera Calibration Method Using a Single Image

A Hybrid Calibration Method for the Binocular Omnidirectional Vision System

A Convenient and High-Accuracy Multicamera Calibration Method Based on Imperfect Spherical Objects

Inter-Camera Color Correction for Multispectral Imaging with Camera Arrays Using a Consensus Image

OmniColor: A Global Camera Pose Optimization Approach of LiDAR-360Camera Fusion for Colorizing Point Clouds

A Fast and Flexible Projector-Camera Calibration System

A New Calibration Technique For Multi-Camera Systems Of Limited Overlapping Field-Of-Views