Abstract:Existing projector-camera calibration methods typically warp keypoints from a camera image to a projector image using estimated homographies and often suffer from errors in camera parameters and noises due to imperfect planarity of the calibration target. This article proposes a practical and robust projector-camera calibration system that explicitly deals with these challenges. First, a graph-theory-based correspondence algorithm is built on top of a color-coded spatial structured light (SL) pattern. Such SL correspondences are then used for a coarse projector-camera calibration. To gain more robustness against noises from an imperfect planar calibration board, we develop a bundle adjustment algorithm to jointly optimize the estimated projector-camera parameters and the correspondences' coordinates. Moreover, our system requires only one shot of an SL pattern for each calibration board pose, which is much more practical than multishot solutions. Comprehensive experimental validation is conducted on both synthetic and real data sets, and our method clearly outperforms the existing methods in all experiments. For the benefit of the society, a practical open-source software with graphical user interface (GUI) of the developed system is publicly available at https://github.com/bingyaohuang/single-shot-pro-cam-calib. Note to Practitioners—The proposed method is motivated by two challenges in industrial structured light (SL) system calibration: 1) robustness against imperfect planarity of the calibration target and 2) the number of SL projections per pose. In many industrial SL-based 3-D reconstruction systems, the calibration accuracy greatly affects the reconstruction reliability. Our SL calibration system explicitly deals with calibration target's imperfect planarity and thus outperforms the existing methods in terms of system accuracy. Another advantage of our-SL calibration system is single-shot-per-pose, allowing fast recalibration and reducing the decoding error due to slight pattern misalignment in multishot methods [37]. In addition, we release the open-source calibration software with a graphical user interface (GUI), with which calibration and sparse 3-D reconstruction can be easily performed without any further instructions. Moreover, considering the complex calibration environment and setup, we make the camera and projector imaging parameters, such as exposure, brightness, and contrast, adjustable through widgets and preview. Finally, a limitation of our color-coded SL system is its sensitivity to environment lighting and target texture. This problem may be solved by projector photometric compensation [16], [18], [19], [39].

A practical radiometric compensation method for projector-based augmentation

A Novel Radiometric Projector Compensation Algorithm Based on Lambertian Reflection Model

Perceptual radiometric compensation for inter-reflection in immersive projection environment.

Camera-based multi-projector radiometric compensation system

Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination

CCD-based system for two-dimensional measurement of color uniformity of LCD projector

Scalable Arbitrary Surrounded Surface Calibration for Multi-projector Rendering Application

Multi-projector Calibration and Alignment Using Flatness Analysis for Irregular-Shape Surfaces

Robust estimation of spectral reflectance by a projector-camera system

Robustness of Projection Algorithm for Under-Exposured Images

An adaptive calibration algorithm for projected images in daily environment.

A Fast and Flexible Projector-Camera Calibration System

Multi-projector Display Based on Pre-correction of the Camera

Blending Luminance Uniformity Matrix: A New Robust Photometric Calibration in Multi-Projector Systems

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

CompenHR: Efficient Full Compensation for High-resolution Projector

Projector Calibration with Error Surface Compensation Method in the Structured Light Three-Dimensional Measurement System

Multi-Projector Tiled Display Wall Calibration With A Camera

A three-phase approach to photometric calibration for multi-projector display using LCD projectors

Phase compensation for projector calibration

Screen Calibration Techniques for Multi-Projector Tiled Display Wall