Abstract:Computer vision tasks, such as motion estimation, depth estimation, object detection, etc., are better suited to light field images with more structural information than traditional 2D monocular images. However, since costly data acquisition instruments are difficult to calibrate, it is always hard to obtain real-world scene light field images. The majority of the datasets for static light field images now available are modest in size and cannot be used in methods such as transformer to fully leverage local and global correlations. Additionally, studies on dynamic situations, such as object tracking and motion estimates based on 4D light field images, have been rare, and we anticipate a superior performance. In this paper, we firstly propose a new static light field dataset that contains up to 50 scenes and takes 8 to 10 perspectives for each scene, with the ground truth including disparities, depths, surface normals, segmentations, and object poses. This dataset is larger scaled compared to current mainstream datasets for depth estimation refinement, and we focus on indoor and some outdoor scenarios. Second, to generate additional optical flow ground truth that indicates 3D motion of objects in addition to the ground truth obtained in static scenes in order to calculate more precise pixel level motion estimation, we released a light field scene flow dataset with dense 3D motion ground truth of pixels, and each scene has 150 frames. Thirdly, by utilizing the DistgDisp and DistgASR, which decouple the angular and spatial domain of the light field, we perform disparity estimation and angular super-resolution to evaluate the performance of our light field dataset. The performance and potential of our dataset in disparity estimation and angular super-resolution have been demonstrated by experimental results.

Dynamic depth estimation of weakly textured objects based on light field speckle projection and adaptive step length of optical flow method

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields

Dynamic 3d Scene Depth Reconstruction Via Optical Flow Field Rectification

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Depth Extraction of Low-Texture Region Using A Light Field Camera

Efficiency–Accuracy Trade-Off in Light Field Estimation with Cost Volume Construction and Aggregation

Revised Depth Map Estimation for Multi-View Stereo.

High quality depth maps from stereo matching and ToF camera.

FlowDepth: Decoupling Optical Flow for Self-Supervised Monocular Depth Estimation

Efficient Active Depth Sensing by Laser Speckle Projection System

DS-Depth: Dynamic and Static Depth Estimation via a Fusion Cost Volume

Robust depth estimation for light field via spinning parallelogram operator

A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation

Enhanced Depth Estimation for Hand-Held Light Field Cameras

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Depth Estimation for Speckle Projection System Using Progressive Reliable Points Growing Matching.

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

Accurate 3D reconstruction of single-frame speckle-encoded textureless surfaces based on densely connected stereo matching network