Abstract:This paper is concerned with the problem of multi-view 3D reconstruction with an un-calibrated micro-lens array based light field camera. To acquire 3D Euclidean reconstruction, existing approaches commonly apply the calibration with a checkerboard and motion estimation from static scenes in two steps. Self-calibration is the process of simultaneously estimating intrinsic and extrinsic parameters directly from un-calibrated light fields without the help of a checkerboard. While the self-calibration technique for conventional (pinhole) camera is well understood, how to extend it to light field camera remains a challenging task. This is primarily due to the ultra-small baseline of the light field camera. We propose an effective self-calibration method for a light field camera for automatic metric reconstruction without a laborious pre-calibration process. In contrast to conventional self-calibration, we show how such a self-calibration method can be made numerically stable, by exploiting the regularity and measurement redundancies unique for the light field camera. The proposed method is built upon the derivation of a novel ray-space homography constraint (RSHC) using Plücker parameterization as well as a ray-space infinity homography (RSIH). We also propose a new concept of “rays of the absolute conic (RAC)” defined as a special quadric in 5D projective space ℙ^5 . A set of new equations are established and solved for self-calibration and 3D metric reconstruction specifically designed for a light field camera . We validate the efficacy of the proposed method on both synthetic and real light fields, and have obtained superior results in both accuracy and robustness.

Simulation of Light-Field Camera Imaging Based on Ray Splitting Monte Carlo Method

Simulation Of Imaging And Refocusing For Light Field Photography

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Microlens Assembly Error Analysis for Light Field Camera Based on Monte Carlo Method

Light Field Imaging: Models, Calibrations, Reconstructions, and Applications

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Multi-focused Microlens Array Optimization and Light Field Imaging Study Based on Monte Carlo Method.

Computer simulation for digital refocusing imager based on light field photography

Design of a Novel Microlens Array and Imaging System for Light Fields

Light-field-camera Imaging Simulation of Participatory Media Using Monte Carlo Method

Ray-Space Projection Model for Light Field Camera.

A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras.

Light Field Acquisition Using Microlens Based on 3ds Max and Image Reconstruction Technology

Light field camera calibration and point spread function calculation based on differentiable ray tracing

Computer modeling and simulation of light field camera and digital refocusing with attenuating mask

3D Scene Reconstruction with an Un-calibrated Light Field Camera

Light Field Camera Self-Calibration and Registration

Simulation tools for light-field displays based on a micro-lens array.

High-Quality Light Field Microscope Imaging Based on Microlens Arrays

Consistency Analysis of Focal Stack-Based Light Field Reconstruction

Camera Array Based Light Field Microscopy