Abstract:Light field imaging can encode abundant scene information, including the intensity and direction of light rays, into 4D light field images. However, the limited number of sensors in commercial light field cameras leads to a trade-off between spatial and angular resolutions. In this paper, an angular super-resolution framework is proposed to synthesize new views and overcome hardware restrictions. First, light field intrinsic feature convolution is proposed to extract intrinsic information, i.e., scene content, complete view correlations, and epipolar structures. Consequently, spatial, angular, and cross-domain information can be preserved in the extracted features. Second, the spatial-angular and depth streams are proposed based on the light field intrinsic feature convolution to synthesize high angular resolution light fields. The spatial-angular stream utilizes the light field intrinsic information to improve the angular resolution, whereas the depth stream disentangles the geometric information from the extracted light field intrinsic features, which is used to warp the given sub-aperture images to the new view positions. Both streams can synthesize high-quality intermediate results, where the intrinsic and geometric information are utilized separately. Finally, a confidence-based stream fusion module is proposed to fuse the outputs from the two streams, achieving the joint employment of light field intrinsic and geometric information and solving the problem of insufficient information exploration in the current methods. We conduct a series of experiments to validate the effectiveness of each component in the framework and demonstrate that our method can achieve state-of-the-art performance in various scenes.(c) 2023 Elsevier B.V. All rights reserved.

Snapshot Hyperspectral Light Field Imaging

Three Dimensional Surface Reconstruction Based on Light Field Imaging

A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Snapshot hyperspectral light field tomography

A Snapshot Light Field Imaging Spectrometer

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain

High Light Efficiency Snapshot Spectral Imaging Via Spatial Multiplexing and Spectral Mixing.

Snapshot depth–spectral imaging based on image mapping and light field

Light Field Imaging: Models, Calibrations, Reconstructions, and Applications

High-speed Hyperspectral Video Acquisition with a Dual-Camera Architecture.

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Light field angular super-resolution based on intrinsic and geometric information.

High-Speed Hyperspectral Video Acquisition by Combining Nyquist and Compressive Sampling

Snapshot Spectral Polarimetric Light Field Imaging Using a Single Detector.

Snapshot Hyperspectral Retinal Imaging Using Compact Spectral Resolving Detector Array

Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array

Ultra-compact snapshot spectral light-field imaging

Spectral-depth imaging with deep learning based reconstruction.