Abstract:Computer vision tasks, such as motion estimation, depth estimation, object detection, etc., are better suited to light field images with more structural information than traditional 2D monocular images. However, since costly data acquisition instruments are difficult to calibrate, it is always hard to obtain real-world scene light field images. The majority of the datasets for static light field images now available are modest in size and cannot be used in methods such as transformer to fully leverage local and global correlations. Additionally, studies on dynamic situations, such as object tracking and motion estimates based on 4D light field images, have been rare, and we anticipate a superior performance. In this paper, we firstly propose a new static light field dataset that contains up to 50 scenes and takes 8 to 10 perspectives for each scene, with the ground truth including disparities, depths, surface normals, segmentations, and object poses. This dataset is larger scaled compared to current mainstream datasets for depth estimation refinement, and we focus on indoor and some outdoor scenarios. Second, to generate additional optical flow ground truth that indicates 3D motion of objects in addition to the ground truth obtained in static scenes in order to calculate more precise pixel level motion estimation, we released a light field scene flow dataset with dense 3D motion ground truth of pixels, and each scene has 150 frames. Thirdly, by utilizing the DistgDisp and DistgASR, which decouple the angular and spatial domain of the light field, we perform disparity estimation and angular super-resolution to evaluate the performance of our light field dataset. The performance and potential of our dataset in disparity estimation and angular super-resolution have been demonstrated by experimental results.

A Survey on Deep Learning Methods for Scene Flow Estimation

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Scene Flow Estimation: A Survey.

A Dense Optical Flow Registration Algorithm Based on Deep Learning

DeepLiDARFlow: A Deep Learning Architecture For Scene Flow Estimation Using Monocular Camera and Sparse LiDAR

Survey on Unsupervised Learning Methods for Optical Flow Estimation

SeFlow: A Self-Supervised Scene Flow Method in Autonomous Driving

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

D^3FlowSLAM: Self-Supervised Dynamic SLAM with Flow Motion Decomposition and DINO Guidance

Deep Learning Approaches in Flow Visualization

Self-Supervised Monocular Scene Flow Estimation

Traditional and modern strategies for optical flow: an investigation

A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation

DELFlow: Dense Efficient Learning of Scene Flow for Large-Scale Point Clouds

Self-Supervised Scene Flow Estimation with Point-Voxel Fusion and Surface Representation

Unsupervised Deep Learning for Optical Flow Estimation.

Semantic Flow: Learning Semantic Field of Dynamic Scenes from Monocular Videos

Hierarchical Attention Learning of Scene Flow in 3D Point Clouds

LiDAR-Flow: Dense Scene Flow Estimation from Sparse LiDAR and Stereo Images

Bi-PointFlowNet: Bidirectional Learning for Point Cloud Based Scene Flow Estimation

Bridging the Domain Gap in Scene Flow Estimation via Hierarchical Smoothness Refinement