Abstract:Compared to 2D imaging data, the 4D light field (LF) data retains richer scene's structure information, which can significantly improve the computer's perception capability, including depth estimation, semantic segmentation, and LF rendering. However, there is a contradiction between spatial and angular resolution during the LF image acquisition period. To overcome the above problem, researchers have gradually focused on the light field super-resolution (LFSR). In the traditional solutions, researchers achieved the LFSR based on various optimization frameworks, such as Bayesian and Gaussian models. Deep learning-based methods are more popular than conventional methods because they have better performance and more robust generalization capabilities. In this paper, the present approach can mainly divided into conventional methods and deep learning-based methods. We discuss these two branches in light field spatial super-resolution (LFSSR), light field angular super-resolution (LFASR), and light field spatial and angular super-resolution (LFSASR), respectively. Subsequently, this paper also introduces the primary public datasets and analyzes the performance of the prevalent approaches on these datasets. Finally, we discuss the potential innovations of the LFSR to propose the progress of our research field. (c) 2024 The Author(s). Published by Elsevier B.V. on behalf of Shandong University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

3D Localization of Point Source Based on Light Field Imaging and Deep Learning

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

A Method Of 3d Light Field Imaging Through Single Layer Of Weak Scattering Media Based On Deep Learning

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Deep learning-based scattering removal of light field imaging

3D Single Molecule Localization Microscopy Via Deep Learning

Three-Dimensional Measurement Method of Light Field Imaging Based on Deep Learning

Light Field SLAM Based on Ray-Space Projection Model

High Sensitive Locating Through Scattering Medium with Phase-Space-prior

DeepLFM: Deep Learning-based 3D Reconstruction for Light Field Microscopy

Imaging through unknown scattering media based on physics-informed learning

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Non-Invasive Imaging Through Scattering Media Based on Deep Learning

A survey for light field super-resolution

Light Field Reconstruction With A Hybrid Sparse Regularization-Pseudo 4dcnn Framework

The Light Field 3D Scanner.

Zero-Shot Depth Estimation from Light Field Using A Convolutional Neural Network

Unsupervised Learning of High-resolution Light Field Imaging via Beam Splitter-based Hybrid Lenses

Deep Learning for Precise Axial Localization of Trapped Microspheres in Reflective Optical Systems.

A Novel Global Localization Method Using 3D Laser Range Data in Large-Scale and Sparse Environments

Long-Range Non-Line-of-Sight Imaging Based on Projected Images from Multiple Light Fields