Abstract:High performance imaging of large-scale dynamic scenes is substantial to vision intelligence. The light field is a 31) plenoptic function that describes the amount of light flow in every direction through every point in space. By recording the high dimensional light signal, the light field can accurately perceive the complex dynamic environment, supporting the understanding and decision-making of the intelligent system. Computational light field imaging technique, based on the light field and the representation of plenoptic function, aims to combine computation, digital sensors, optical system, and intelligent lighting, thereby combining the hardware design and software computing power. This technique breaks through the limits of classical imaging model and digital camera, establishes the relationship among light in spatial, angular, spectral, and temporal dimensions, realizes coupling perception, decoupling reconstruction, and intelligent processing, and leads to the multi-dimensional and multi-scale imaging ability for large-scale dynamic scenes. Light field imaging technique plays vital role in various fields, including life science, industrial inspection, national security, unmanned system, VR/AR, etc., attracting broad interests from both academia and industry. With the discrete sampling of high dimensional data, light field imaging faces the challenge of dimension trade-off between spatial resolution and angular resolution. How to reconstruct light field for sparse sampled data becomes a fundamental problem in computational light field imaging and its applications. Meanwhile, limited by high dimensional data perception of light field signals, light field process faces the contradiction between effective data perception and computational efficiency. How to replace the traditional two-dimensional imaging visual perception method with light field which is a high-dimensional information acquisition means and how to combine intelligent information processing technique to realize intelligent efficient perception, arc huge challenges for industrial applications of the light field imaging technique. In this paper, we conduct a thorough literature review of devices and algorithms of computational light field imaging, including the representation and theory of light field, light field signal sampling, and light field reconstruction with super-resolution in spatial and angular domain.

5D light field for navigation in occluded environment

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Computational Light Field Imaging

Review of light field technologies

Directional and Eye-Tracking Light Field Display with Efficient Rendering and Illumination

A 360-degree floating 3D display based on light field regeneration.

Light Field Depth Estimation Exploiting Linear Structure in EPI

Plenoptic Reconstruction

360 Deg Full-Parallax Light-Field Display Using Panoramic Camera

Light Field Image Processing: An Overview

Toward Low-Computation Light Field Displays by Foveated Rendering

Parallel Light Fields: A Perspective and A Framework

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Light field projection for lighting reproduction

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation