Abstract:High performance imaging of large-scale dynamic scenes is substantial to vision intelligence. The light field is a 31) plenoptic function that describes the amount of light flow in every direction through every point in space. By recording the high dimensional light signal, the light field can accurately perceive the complex dynamic environment, supporting the understanding and decision-making of the intelligent system. Computational light field imaging technique, based on the light field and the representation of plenoptic function, aims to combine computation, digital sensors, optical system, and intelligent lighting, thereby combining the hardware design and software computing power. This technique breaks through the limits of classical imaging model and digital camera, establishes the relationship among light in spatial, angular, spectral, and temporal dimensions, realizes coupling perception, decoupling reconstruction, and intelligent processing, and leads to the multi-dimensional and multi-scale imaging ability for large-scale dynamic scenes. Light field imaging technique plays vital role in various fields, including life science, industrial inspection, national security, unmanned system, VR/AR, etc., attracting broad interests from both academia and industry. With the discrete sampling of high dimensional data, light field imaging faces the challenge of dimension trade-off between spatial resolution and angular resolution. How to reconstruct light field for sparse sampled data becomes a fundamental problem in computational light field imaging and its applications. Meanwhile, limited by high dimensional data perception of light field signals, light field process faces the contradiction between effective data perception and computational efficiency. How to replace the traditional two-dimensional imaging visual perception method with light field which is a high-dimensional information acquisition means and how to combine intelligent information processing technique to realize intelligent efficient perception, arc huge challenges for industrial applications of the light field imaging technique. In this paper, we conduct a thorough literature review of devices and algorithms of computational light field imaging, including the representation and theory of light field, light field signal sampling, and light field reconstruction with super-resolution in spatial and angular domain.

High-resolution 3D light-field imaging

In Vivo Light-Field Encoded Nano-Imaging in a Narrow Space

Extended Depth of Field Reconstruction with Complex Field Estimation

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Phase Guided Light Field for Spatial-Depth High Resolution 3D Imaging

Virtual-scanning light-field microscopy for robust snapshot high-resolution volumetric imaging

Multi-focus Light-Field Microscopy for High-Speed Large-Volume Imaging

Design of a light field microscope with uniform spatial resolution across an extended 3D volume

High-fidelity and fast 3D imaging of subcellular dynamics in native states

High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Video-rate 3D imaging of living cells using Fourier view-channel-depth light field microscopy

Noise-robust phase-space deconvolution for light-field microscopy

High-speed in toto 3D imaging with isotropic resolution by scanning light-field tomography

High-speed 4D fluorescence light field tomography of whole freely moving organisms

Light Field Fourier Ptychographic Microscopy

Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning

Computational Light Field Imaging

Camera Array Based Light Field Microscopy

Optical single-pixel volumetric imaging by three-dimensional light-field illumination

Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

Network-based instantaneous recording and video-rate reconstruction of 4D biological dynamics