Abstract:Light field imaging can encode abundant scene information, including the intensity and direction of light rays, into 4D light field images. However, the limited number of sensors in commercial light field cameras leads to a trade-off between spatial and angular resolutions. In this paper, an angular super-resolution framework is proposed to synthesize new views and overcome hardware restrictions. First, light field intrinsic feature convolution is proposed to extract intrinsic information, i.e., scene content, complete view correlations, and epipolar structures. Consequently, spatial, angular, and cross-domain information can be preserved in the extracted features. Second, the spatial-angular and depth streams are proposed based on the light field intrinsic feature convolution to synthesize high angular resolution light fields. The spatial-angular stream utilizes the light field intrinsic information to improve the angular resolution, whereas the depth stream disentangles the geometric information from the extracted light field intrinsic features, which is used to warp the given sub-aperture images to the new view positions. Both streams can synthesize high-quality intermediate results, where the intrinsic and geometric information are utilized separately. Finally, a confidence-based stream fusion module is proposed to fuse the outputs from the two streams, achieving the joint employment of light field intrinsic and geometric information and solving the problem of insufficient information exploration in the current methods. We conduct a series of experiments to validate the effectiveness of each component in the framework and demonstrate that our method can achieve state-of-the-art performance in various scenes.(c) 2023 Elsevier B.V. All rights reserved.

Light Field Reconstruction from Projection Modeling of Focal Stack

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Light Field Reconstruction from Focal Stack Based on Landweber Iterative Scheme

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Consistency Analysis of Focal Stack-Based Light Field Reconstruction

Iteratively Reconstructing 4D Light Fields from Focal Stacks.

The Light Field 3D Scanner.

Light Field Acquisition Using Microlens Based on 3ds Max and Image Reconstruction Technology

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Light field angular super-resolution based on intrinsic and geometric information.

Micro-Lens Image Stack Upsampling for Densely-Sampled Light Field Reconstruction

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

A Method for 3D Light-Field Reconstruction Based on a Spatially Free Camera

Light Field Reconstruction using Efficient Pseudo 4D Epipolar-Aware Structure

Compact Representation of Light Field Data for Refocusing and Focal Stack Reconstruction Using Depth Adaptive Multi-CNN

Phase Guided Light Field for Spatial-Depth High Resolution 3D Imaging

Light Field Reconstruction via Deep Adaptive Fusion of Hybrid Lenses

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Computer simulation for digital refocusing imager based on light field photography

Production Method of Light Field Image Simulation Based on 3ds Max 3D Reconstruction

Light Field Reconstruction Using Deep Convolutional Network On Epi