Abstract:This paper is concerned with the problem of multi-view 3D reconstruction with an un-calibrated micro-lens array based light field camera. To acquire 3D Euclidean reconstruction, existing approaches commonly apply the calibration with a checkerboard and motion estimation from static scenes in two steps. Self-calibration is the process of simultaneously estimating intrinsic and extrinsic parameters directly from un-calibrated light fields without the help of a checkerboard. While the self-calibration technique for conventional (pinhole) camera is well understood, how to extend it to light field camera remains a challenging task. This is primarily due to the ultra-small baseline of the light field camera. We propose an effective self-calibration method for a light field camera for automatic metric reconstruction without a laborious pre-calibration process. In contrast to conventional self-calibration, we show how such a self-calibration method can be made numerically stable, by exploiting the regularity and measurement redundancies unique for the light field camera. The proposed method is built upon the derivation of a novel ray-space homography constraint (RSHC) using Plücker parameterization as well as a ray-space infinity homography (RSIH). We also propose a new concept of “rays of the absolute conic (RAC)” defined as a special quadric in 5D projective space ℙ^5 . A set of new equations are established and solved for self-calibration and 3D metric reconstruction specifically designed for a light field camera . We validate the efficacy of the proposed method on both synthetic and real light fields, and have obtained superior results in both accuracy and robustness.

Parameters Estimation-Based Calibration Method for Rotational Axis of Line-Structured Light 3D Reconstruction.

Line Structured Light Calibration System Based on Planar Complementary Target

A Novel Method to Calibrate the Rotation Axis of a Line-Structured Light 3-Dimensional Measurement System

Multiconstraint Spatial and Temporal Calibration of Rotating Line Structured Light Vision Sensor

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Rotation Axis Calibration of Laser Line Rotating-Scan System for 3D Reconstruction.

Extrinsic Calibration of A 3d Lidar and A Camera Using A Trihedron

Unsupervised Extrinsic Parameters Calibration for Multi-beam LIDARs

A Calibration Method for a Self-Rotating, Linear-Structured-Light Scanning, Three-Dimensional Reconstruction System Based on Plane Constraints

An Approach for Calibrating Rotor Position of Three-Dimensional Measurement System for Line-Structure Light

3D Scene Reconstruction with an Un-calibrated Light Field Camera

A new calibration approach of rotor axes for 3D measurement system

3D Reconstruction of Rotating Objects Based on Line Structured-Light Scanning

Efficient and robust camera extrinsic parameters calibration algorithm

Rectifying Projective Distortion In 4d Light Field

Research on 3D Reconstruction Method Based on Laser Rotation Scanning

Calibration of a Catadioptric System and 3D Reconstruction Based on Surface Structured Light

Calibration Method for Line-Structured Light Three-Dimensional Measurement Based on a Simple Target

Rotation Axis Calibration of a 3D Scanning System Based on Dual-Turntable Angle Cancellation.

Simple Calibration Method for Three-Dimensional Imaging System with Structured Light

Calibration method of three dimensional (3D) laser measurement system based on projective transformation