Abstract:Plenoptic cameras have been increasingly applied in three-dimensional (3D) optical imaging and measurements. Micro-lens array is the key component to capture the images at different depths simultaneously to realize the 3D reconstruction of the scenery. However, only a part of the captured information will be used eventually when focusing on specific objects, which implies a waste of time and resources that are incompetent for fast-response tasks like gesture recognition. Furthermore, it is still quite challenging to accurately calibrate the depths under complex circumstances, even sometimes losing a part of the target information due to the low signal-to-noise ratio. In this paper, a new hybrid optical system is developed combining a geometrical waveguide and micro-lens array to project a virtual scale network for quantitative depth calibration and fast-tracking of targets. Such a methodology based on the augmented reality (AR) mechanism helps to rapidly scope the targeted objects/features without reconstructing the full range model, significantly saving the processing time for a low-latency response. By establishing a geometrical model to quantitatively correlate the images in the auxiliary coordinate system and the virtual scale coordinate system, the depth error caused by the plenoptic camera can be calibrated and corrected. The coefficient of determination R 2 is used to evaluate the depth accuracy of 3D images and acts as the threshold to control the depth correction iterations. The closer the value of R 2 is to 1, the more accurate the depth information is. Experiments proved that even under complex backgrounds or insufficient light, in virtue of the virtual coordinate networks, backgrounds could be rapidly filtered, and targets were effectively identified with accurate depth information. The algorithm flow chart for the correction of depth error is given. In such a way, the system can achieve faster and more accurate capturing of 3D objects in a real-time manner than conventional plenoptic cameras.

Optical arbitrary-depth refocusing for large-depth scene in integral imaging display based on reprojected parallax image

Multi-image-distance Imaging System for Extending Depth-of-field

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Extended Depth of Field Reconstruction with Complex Field Estimation

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Relative Depth Estimation With An Uncalibrated Camera For Image Refocus

Stereo Image Rectification Algorithm for Multi-View 3D Display

Least Square Support Vector Machines as an Alternative Method in Seasonal Time Series Forecasting

360-degree large-scale multiprojection light-field 3D display system.

A New Virtual View Rendering Method Based on Depth Image

3D reconstruction from bifocus imaging

Multi-face Real-Time Tracking Based on Dual Panoramic Camera for Full-Parallax Light-Field Display

17.2: Large‐scale Color Omnidirectional‐view Three‐dimensional Display Based on Projector Array

Dual-mode optical see-through integral imaging 3D display with large depth of field

Guided, Fusion-Based, Large Depth-of-field 3D Imaging Using a Focal Stack

Autostereoscopic 3D Display with Long Visualization Depth Using Referential Viewing Area-Based Integral Photography

Large Depth-of-field Fringe Projection Profilometry Applied to Defocused Scenes

Depth error correction for plenoptic cameras based on an innovative AR system combining geometrical waveguide and micro-lens array

Orthoscopic integral imaging for different lenslet arrays in real and virtual fields

Refocusing Images Captured from a Stereoscopic Camera