Abstract:Optical image stabilizers (OIS) are widely used in digital cameras to counteract motion blur caused by camera shakes in capturing videos and photos. In this paper, we sought to expand the applicability of the lens-shift OIS technology for metric depth estimation, i.e., let a RGB camera to achieve the similar function of a time-of-flight (ToF) camera. Instead of having to move the entire camera for depth estimation, we propose DoCam, which controls the lens motion in the OIS module to achieve 3D reconstruction. After controlling the lens motion by altering the MEMS gyroscopes readings through acoustic injection, we improve the traditional bundle adjustment algorithm by establishing additional constraints from the linearity of the lens control model for high-precision camera pose estimation. Then, we elaborate a dense depth reconstruction algorithm to compute depth maps at real-world scale from multiple captures with micro lens motion (i.e., <= 3 mm). Extensive experiments demonstrate that our proposed DoCam can enable a 2D color camera to estimate high-accuracy depth information of the captured scene by means of controlling lens motion in the OIS. DoCam is suitable for a variety of applications that require depth information of the scenes, especially when only a single color camera is available and located at a fixed position.

Enhanced Depth Estimation for Hand-Held Light Field Cameras

DoCam: Depth Sensing with an Optical Image Stabilization Supported RGB Camera.

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Guided depth enhancement via a fast marching method

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Depth map enhancement based on color and depth consistency

Enhanced Depth Estimation for Light Field Cameras by Variable-Patch-Size Tensor Extraction

Depth Fused from Intensity Range and Blur Estimation for Light-Field Cameras

Depth Extraction from a Light Field Camera Using Weighted Median Filtering.

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Depth Map Estimation with 4D Light Fields Using Confocal Stereo

Depth Estimation from Light Field Using Graph-Based Structure-Aware Analysis.

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Depth Extraction of Low-Texture Region Using A Light Field Camera

Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Fast Response Aggregation for Depth Estimation Using Light Field Camera

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

Light Field Depth Estimation Exploiting Linear Structure in EPI

Anti-Noise Light Field Depth Estimation Using Inline Occlusion Handling