Camera calibration optimization algorithm that uses a step function

Jiachun Huang,Shaoli Liu,Jianhua Liu,Zehua Jian

DOI: https://doi.org/10.1364/oe.516126

IF: 3.8

2024-05-08

Optics Express

Abstract:Jiachun Huang, Shaoli Liu, Jianhua Liu, Zehua Jian Camera calibration is very important when planning machine vision tasks. Calibration may involve 3D reconstruction, size measurement, or ... [Opt. Express 32, 18453-18471 (2024)]

optics

What problem does this paper attempt to address?

Camera Calibration Technique Based on Virtual 3D Object

CHEN Hua-hua,GUO Ye,DU Xin

DOI: https://doi.org/10.3969/j.issn.1004-1699.2006.04.082

2006-01-01

Abstract:Absolute rotation and translation matrixes from unconstrained movements of multiple 2D coplanar planes are converted to relative ones respective to the reference view of the camera. A virtual 3D object is simulated using the reference position of the plane and the relative matrixes. It avoids the shortcoming , which movements of multiple 2D coplanar planes are performed by special equipments in order to compute successfully parameters of camera, of traditional 3D simulation. A calibration method based on the principle including pinhole model and nonlinear model is applied to the constructed 3D object and the simulated result shown that the proposal method has higher accuracy.
An Optimization Based Vision Calibration Method for PTZ Camera's Errors in Model and Execution

Qiqin Dai,Rong Xiong,Shen Li

DOI: https://doi.org/10.1016/j.proeng.2011.08.110

2011-01-01

Procedia Engineering

Abstract:Traditional vision calibration methods only consider the identification of intrinsic and extrinsic parameters of camera. However, if merely traditional methods are used, too much deviation on target locating for biped walking robot, which camera sensor is mounted on a pan-tilt unit, would caused by unavailability of distance from pan-tilt unit to imaging plane and the inevitable error in execution of pan-tilt unit. In this paper we present an optimization based vision calibration method for errors in model and execution of pan-tilt unit in humanoid robot. This calibration method is constructed as an optimization problem to simultaneously get intrinsic and extrinsic parameters of camera, mechanical installation error, and pan-tilt unit's operation error to guarantee the accuracy of target locating. The effectiveness of the method proposed has been validated on the kid size humanoid robot Wukong. (C) 2011 Published by Elsevier Ltd. Selection and/or peer-review under responsibility of [CEIS 2011]
Camera Calibration Method Based on Phase Encoding for Out-of-focus Condition

Yang Hao,Cai Ning,Lin Bin,Cao Xiangqun

DOI: https://doi.org/10.12086/oee.2018.180100

2018-01-01

Abstract:The state-of-art camera calibration method requires the user to provide accurate pixel coordinates of calibration plate feature points. For some cameras with special sensing range, general calibration objects' (such as calibration plates with a centimeter-long dimension) using range is outside their clear sensing range. Using these cameras to take a picture for general calibration objects, you can only get out-of-focused blurred images that can not accurately extract feature points' pixel coordinates. This paper analyzes the influence on the phase of the structured light based on sine grating (abbreviated as sinusoidal structured light) when optical system is in defocus state. Based on the fact that the state of focus is independent of the phase of sinusoidal structured light, a method of phase-shifted sinusoidal structured light encoding by phase shift is proposed to encode the feature points on the calibration object and this method realizes the calibration of the camera under out-of-focus condition. The experimental results show that the maximal deviation of focal length from the real value is 0.47% and the maximal pixel reprojection error is 0.17 pixels. This paper provides a solution to camera calibration with a special sensing range.
Camera Self-Calibration from Multi-View Images

Qiuyan Guo,Ping An,Zhaoyang Zhang

DOI: https://doi.org/10.3969/j.issn.1005-9490.2008.01.069

2008-01-01

Abstract:Camera calibration is a key technology in computer vision field, in which self-calibration is to compute camera intrinsic parameters only from a series of images. The Kruppa’s equations method not only needs to compute the fundamental matrix which includes all of the geometricaly relation between images, but also needs to compute the epipoles which variate with the different images. Hartley deduced a simple form of Kruppa’s equations in terms of fundamental matrix. The goal of this paper is to convert the equations into the form of cost function according to the Hartley’s deduction and calculate the cost function by the sum of fundamental matrixes multiplying the corresponding weighting factors that are related with the number of matching features.The genetic optimal algorithms are used to obtain the minimum value of the cost function. Our algorithm doesn’t require computing the images epipoles so that it avoids the instability of the results and reduces the calculation burden. Experimental results show that the proposed algorithm is more effective and accurate and can become a versatile tool for camera calibration,which will be used in our cameras array calibration.
A Novel Camera Calibration Method Based on Multiple Calibration Planes

Peng Huang,Zhiwei Liu,Zhenlian Sun,Xinjian Gu,Jianguo Feng

DOI: https://doi.org/10.1145/3436286.3436748

2020-01-01

Abstract:In the large-scale vision measurement of the industrial field, it needs to not only build the high quality image acquisition system, but also calibrate the camera precisely. This paper proposes a camera calibration method based on 3D target, which consists of multiple planes with large viewing angle and range. Based on Zhang's calibration method, multiple intermediate coordinate systems are used to unify the vision sensor to the preset global coordinate system. The singular value decomposition method is adopted to solve the rotation matrix, when the external parameters are fused. Numerical experiments show that this method has high precision and stability.
Multi-camera Calibration Based on Multi-view Registration Algorithm

宓桃,安平,刘苏醒,张兆杨

2008-01-01

Abstract:Camera calibration is a key technology in computer vision,and multi-camera calibration is the inevitable step towards an efficient use of multi-camera systems. For multi-camera systems,a method based on multi-view registration is proposed. A planar model with known reference points placed at a few different locations is only required as a calibration object. Using constrained optimization method,each camera coordinate system can be translated into reference camera coordinate system,and thus can get the relative positions between them. The experimental results show that the method is practical in multi-view calibration.
A planar constraint optimization method to improve camera calibration for imperfect planar targets

Wei Huang,Huisi Miao,Shuming Jiao,Wei Miao,Changyan Xiao,Yaonan Wang

DOI: https://doi.org/10.1016/j.optlaseng.2024.108273

IF: 5.666

2024-05-18

Optics and Lasers in Engineering

Abstract:Camera calibration is a crucial step in vision-based measurement systems. However, the accuracy of camera calibration is affected by the imprecise calibration targets. To remedy the deviations caused by imperfect planar targets, a planar constraint optimization method is proposed to improve camera calibration on the basis of a virtual perfect plane deviation model. This method allows us to correct the target geometry within a truth scale factor. Specifically, we add deviation parameters for each feature point on the target relative to a virtual perfect plane, which is used to describe the machining errors. Those deviation parameters will be optimized together with the calibration parameters of the camera to correct the feature points' position and improve calibration accuracy. Both simulation and real experiments have demonstrated that the proposed method can attain high-precision calibration results and measurement accuracy comparable to those with traditional method and a precise target, even using an imperfect target.

optics
Efficient and robust camera extrinsic parameters calibration algorithm

Xifan Shi,Changyu Diao,Dongming Lu

2007-01-01

Journal of Computational Information Systems

Abstract:The camera extrinsic parameters are composed of 3 rotation angles and a translation vector, which has 3 components, and the calibration process identifies these 6 parameters. It is proved that at least 3 corresponding points should be given for the process and when more than 3 points are given, the system is over determined and has to be solved by minimizing the RMS error. In this paper, a camera extrinsic parameters calibration algorithm or camera pose estimation algorithm is studied. The algorithm ensures its efficiency (20 milliseconds if no more than 9 corresponding points are given) and robustness by a good initial value guess and an omnidirectional search for poor input data. It has been successfully used in texture mapping for cultural relics such as a jade chisel from Jinsha (an archaeological site in the western suburbs of Chengdu) and a Buddha statue from Zhejiang Provincial Museum.
Camera Calibration with Active Phase Target: Improvement on Feature Detection and Optimization

Lei Huang,Qican Zhang,Anand Asundi

DOI: https://doi.org/10.1364/ol.38.001446

IF: 3.6

2013-01-01

Optics Letters

Abstract:The calibration of camera with intrinsic and extrinsic parameters is a procedure of significance in current imaging-based optical metrology. Improvement at two aspects, feature detection and overall optimization, are investigated here by using an active phase target and statistically constrained bundle adjustment (SCBA). From the observations in experiment and simulation, the feature detection can be enhanced by "virtual defocusing" and windowed polynomial fitting if sinusoidal fringe patterns are used as the active phase target. SCBA can be applied to avoid the difficult measurement of the active target. As a typical calibration result in our experiment, the root mean square of reprojection error can be reduced to 0.0067 pixels with the proposed method.
Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Xia Liu,Zhenyu Liu,Guifang Duan,Jin Cheng,Xuetao Jiang,Jianrong Tan

DOI: https://doi.org/10.1364/ao.57.005130

IF: 1.9

2018-01-01

Applied Optics

Abstract:Precise calibration of a binocular vision system is the foundation of binocular vision measurement. In this paper, we propose a highly precise and robust binocular camera calibration method, which is devoted to minimize the error between the geometric relation of 3D reconstructed feature points and the ground truth, such as adjacent distance error, collinear error, and right-angle error. In addition, the reprojection error and epipolar are introduced to satisfy the homography relation and epipolar geometry theory better. We optimize all intrinsic parameters, extrinsic parameters, and distortion parameters to minimize the objective function, which is the sum of a series of nonlinear least squares terms. Levenberg-Marquardt iterative algorithm is used to find the optimal solution of the camera parameters. To test the precision and robustness of the proposed method, both actual measurement experiments and Gauss noise-adding experiments are carried out. The experimental results show that compared with the other two calibration methods in the contrast experiment, the distance measurement error, collinear error, and right-angle error are reduced dramatically. It is noticeable that in Gauss noise-adding experiments, the calibration parameters estimated by the proposed method are more stable.
A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

Ke-Li Cheng,Xuan Ju,Ruo-Feng Tong,Min Tang,Jian Chang,Jian-Jun Zhang

DOI: https://doi.org/10.1007/s11390-016-1641-7

IF: 1.871

2016-01-01

Journal of Computer Science and Technology

Abstract:Many recent applications of computer graphics and human computer interaction have adopted both colour cameras and depth cameras as input devices. Therefore, an effective calibration of both types of hardware taking different colour and depth inputs is required. Our approach removes the numerical difficulties of using non-linear optimization in previous methods which explicitly resolve camera intrinsics as well as the transformation between depth and colour cameras. A matrix of hybrid parameters is introduced to linearize our optimization. The hybrid parameters offer a transformation from a depth parametric space (depth camera image) to a colour parametric space (colour camera image) by combining the intrinsic parameters of depth camera and a rotation transformation from depth camera to colour camera. Both the rotation transformation and intrinsic parameters can be explicitly calculated from our hybrid parameters with the help of a standard QR factorisation. We test our algorithm with both synthesized data and real-world data where ground-truth depth information is captured by Microsoft Kinect. The experiments show that our approach can provide comparable accuracy of calibration with the state-of-the-art algorithms while taking much less computation time (1/50 of Herrera’s method and 1/10 of Raposo’s method) due to the advantage of using hybrid parameters.
A High-Quality and Convenient Camera Calibration Method Using a Single Image

Xufang Qin,Xiaohua Xia,Huatao Xiang

DOI: https://doi.org/10.3390/electronics13224361

IF: 2.9

2024-11-07

Electronics

Abstract:Existing camera calibration methods using a single image have exhibited some limitations. These limitations include relying on large datasets, using inconveniently prepared calibration objects instead of commonly used planar patterns such as checkerboards, and requiring further improvement in accuracy. To address these issues, a high-quality and convenient camera calibration method is proposed, which only requires a single image of the commonly used planar checkerboard pattern. In the proposed method, a nonlinear objective function is derived by leveraging the linear distribution characteristics exhibited among corners. An algorithm based on enumeration theory is designed to minimize this function. It calibrates the first two radial distortion coefficients and principal points. The focal length and extrinsic parameters are linearly calibrated from the constraints provided by the linear projection model and the unit orthogonality of the rotation matrix. Additionally, a guideline is explored through theoretical analysis and numerical simulation to ensure calibration quality. The quality of the proposed method is evaluated by both simulated and real experiments, demonstrating its comparability with the well-known multi-image-based method and its superiority over advanced single-image-based methods.

engineering, electrical & electronic,computer science, information systems,physics, applied
Efficient Calibration Method for Vision Navigation Camera

SUN Jie,ZHU Shi-qiang,LAI Xiao-bo

DOI: https://doi.org/10.3969/j.issn.1000-3428.2010.21.076

2010-01-01

Abstract:Aiming at the camera calibration in vision navigation system of mobile robot,this paper proposes an efficient method of camera calibration.The radial distortion and tangential distortion is taken into account.Hough transform is applied to extract the checkboard corners,and initial values of camera parameters are obtained.Levenberg Marquardt algorithm is used for nonlinear iteration optimization.The corners are reprojected to the rectangular checkboard,the corners extracted are compared with Hough transform,and the causes of error are analyzed.The results show that this method of anti-noise ability is strong,and the experimental conditions are relatively low.The precision completely satisfies requirement of actual navigation,which is suitable for camera calibration of mobile robot.
Effective camera calibration in free-viewpoint systems

Liu Liliang,An Ping,Zheng Zhuan,Zhang Zhaoyang

DOI: https://doi.org/10.1049/cp.2011.0847

2011-01-01

Abstract:Multi-camera calibration parameters are needed in free-viewpoint video system to obtain virtual viewpoint. Most existing calibration technologies are for single camera and further research is needed for multi-camera calibration. A multi-camera calibration method based on 2D plane calibration algorithm combined with stereo vision calibration is proposed in this paper. Camera intrinsic parameters can be obtained using 2D plane calibration algorithm. Through transforming the world coordinate system, the unique extrinsic parameters are got. The validity of the proposed method is verified by experiments.
Calibrating Method of Camera in Opto-Electronic System

LI Bo,WANG Xiao-tong,XU Xiao-gang

DOI: https://doi.org/10.3969/j.issn.1003-501x.2006.08.014

2006-01-01

Abstract:A new linear three-step approach for camera calibration was proposed to deal with camera model of one order radial distortion. In the first stage, all extrinsic parameters except for translation vector in Z-axis are computed by using the Radial Alignment Constraint (RAC). In the second stage, the one order radial distortion parameter is computed by using cross ratio invariability. In the third stage, all the missing parameters are computed by least square method. Experiments with simulated data as well as real image show that the new approach is efficient, robust and accurate. And the approach eliminates the nonlinear iterative calculation processes.
Camera Calibration with Pose Guidance

Yuzhuo Ren,Feng Hu

DOI: https://doi.org/10.1109/icassp39728.2021.9414468

2021-06-06

Abstract:Camera calibration plays a critical role in various computer vision tasks such as autonomous driving or augmented reality. Widely used camera calibration tools utilize plane pattern based methodology, such as using a chessboard or AprilTag board, user’s calibration expertise level significantly affects calibration accuracy and consistency when without clear instruction. Furthermore, calibration is a recurring task that has to be performed each time the camera is changed or moved. It’s also a great burden to calibrate huge amounts of cameras such as Driver Monitoring System (DMS) cameras in a production line with millions of vehicles. To resolve above issues, we propose a calibration system called Calibration with Pose Guidance to improve calibration accuracy, reduce calibration variance among different users or different trials of the same person. Experiment result shows that our proposed method achieves more accurate and consistent calibration than traditional calibration tools.
Camera Calibration Based on Phase Estimation

Peisen Huang,Qinrui Cheng

DOI: https://doi.org/10.1109/TIM.2022.3227554

IF: 5.6

IEEE Transactions on Instrumentation and Measurement

Abstract:We propose a novel camera calibration method based on phase estimation of a periodic grid pattern that is more accurate and robust to image blur, noise, and uneven illumination. Instead of intensity-based geometric feature detection from the calibration image, we extract the phase information to acquire 3-D-to-2-D point correspondence. The calibration procedure includes three steps: 1) estimate the tilt angles of input images based on a pyramid geometry model and remap the images to a canonical fronto-parallel plane to correct perspective distortion; 2) use a highly accurate phase estimation method to localize control points; and 3) apply an iterative refinement method to compute the camera parameters until convergence. Using the perspective correction and phase estimation method together help increase the accuracy of control point localization and consequently of camera calibration. Synthetic as well as real images from high accuracy patterns etched on ceramic plates and low accuracy patterns printed on article show that the proposed method outperforms the most widely-used methods, in terms of accuracy and robustness.

Engineering,Computer Science
Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

Jinshun Ou,Panling Huang,Jun Zhou,Yifan Zhao,Lebin Lin

DOI: https://doi.org/10.3390/s22062221

IF: 3.9

2022-03-13

Sensors

Abstract:In recent years, multi-sensor fusion technology has made enormous progress in 3D reconstruction, surveying and mapping, autonomous driving, and other related fields, and extrinsic calibration is a necessary condition for multi-sensor fusion applications. This paper proposes a 3D LIDAR-to-camera automatic calibration framework based on graph optimization. The system can automatically identify the position of the pattern and build a set of virtual feature point clouds, and can simultaneously complete the calibration of the LIDAR and multiple cameras. To test this framework, a multi-sensor system is formed using a mobile robot equipped with LIDAR, monocular and binocular cameras, and the pairwise calibration of LIDAR with two cameras is evaluated quantitatively and qualitatively. The results show that this method can produce more accurate calibration results than the state-of-the-art method. The average error on the camera normalization plane is 0.161 mm, which outperforms existing calibration methods. Due to the introduction of graph optimization, the original point cloud is also optimized while optimizing the external parameters between the sensors, which can effectively correct the errors caused during data collection, so it is also robust to bad data.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An optimization-based IMU/Lidar/Camera Co-calibration method

Hou lanhua

DOI: https://doi.org/10.48550/arXiv.2209.12355

2022-09-26

Abstract:Recently, multi-sensors fusion has achieved significant progress in the field of automobility to improve navigation and position performance. As the prerequisite of the fusion algorithm, the demand for the extrinsic calibration of multi-sensors is growing. To calculate the extrinsic parameter, many researches have been dedicated to the two-step method, which integrates the respective calibration in pairs. It is inefficient and incompact because of losing sight of the constrain of all sensors. With regard to remove this burden, an optimization-based IMU/Lidar/Camera co-calibration method is proposed in the paper. Firstly, the IMU/camera and IMU/lidar online calibrations are conducted, respectively. Then, the corner and surface feature points in the chessboard are associated with the coarse result and the camera/lidar constraint is constructed. Finally, construct the co-calibration optimization to refine all extrinsic parameters. We evaluate the performance of the proposed scheme in simulation and the result demonstrates that our proposed method outperforms the two-step method.

Robotics
A flexible new technique for camera calibration

Z. Zhang

DOI: https://doi.org/10.1109/34.888718

IF: 23.6

2000-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:We propose a flexible technique to easily calibrate a camera. It only requires the camera to observe a planar pattern shown at a few (at least two) different orientations. Either the camera or the planar pattern can be freely moved. The motion need not be known. Radial lens distortion is modeled. The proposed procedure consists of a closed-form solution, followed by a nonlinear refinement based on the maximum likelihood criterion. Both computer simulation and real data have been used to test the proposed technique and very good results have been obtained. Compared with classical techniques which use expensive equipment such as two or three orthogonal planes, the proposed technique is easy to use and flexible. It advances 3D computer vision one more step from laboratory environments to real world use.

computer science, artificial intelligence,engineering, electrical & electronic

Camera calibration optimization algorithm that uses a step function

Camera Calibration Technique Based on Virtual 3D Object

An Optimization Based Vision Calibration Method for PTZ Camera's Errors in Model and Execution

Camera Calibration Method Based on Phase Encoding for Out-of-focus Condition

Camera Self-Calibration from Multi-View Images

A Novel Camera Calibration Method Based on Multiple Calibration Planes

Multi-camera Calibration Based on Multi-view Registration Algorithm

A planar constraint optimization method to improve camera calibration for imperfect planar targets

Efficient and robust camera extrinsic parameters calibration algorithm

Camera Calibration with Active Phase Target: Improvement on Feature Detection and Optimization

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

A High-Quality and Convenient Camera Calibration Method Using a Single Image

Efficient Calibration Method for Vision Navigation Camera

Effective camera calibration in free-viewpoint systems

Calibrating Method of Camera in Opto-Electronic System

Camera Calibration with Pose Guidance

Camera Calibration Based on Phase Estimation

Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

An optimization-based IMU/Lidar/Camera Co-calibration method

A flexible new technique for camera calibration