Abstract:Light field imaging can encode abundant scene information, including the intensity and direction of light rays, into 4D light field images. However, the limited number of sensors in commercial light field cameras leads to a trade-off between spatial and angular resolutions. In this paper, an angular super-resolution framework is proposed to synthesize new views and overcome hardware restrictions. First, light field intrinsic feature convolution is proposed to extract intrinsic information, i.e., scene content, complete view correlations, and epipolar structures. Consequently, spatial, angular, and cross-domain information can be preserved in the extracted features. Second, the spatial-angular and depth streams are proposed based on the light field intrinsic feature convolution to synthesize high angular resolution light fields. The spatial-angular stream utilizes the light field intrinsic information to improve the angular resolution, whereas the depth stream disentangles the geometric information from the extracted light field intrinsic features, which is used to warp the given sub-aperture images to the new view positions. Both streams can synthesize high-quality intermediate results, where the intrinsic and geometric information are utilized separately. Finally, a confidence-based stream fusion module is proposed to fuse the outputs from the two streams, achieving the joint employment of light field intrinsic and geometric information and solving the problem of insufficient information exploration in the current methods. We conduct a series of experiments to validate the effectiveness of each component in the framework and demonstrate that our method can achieve state-of-the-art performance in various scenes.(c) 2023 Elsevier B.V. All rights reserved.

Light Field Sensor and Real-Time Panorama Imaging Multi-Camera System and the Design of Data Acquisition

Design of High Resolution Panoramic Annular Lens System

Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

Multi-image-distance Imaging System for Extending Depth-of-field

Panoramic Light Field Video Acquisition

Light Field Imaging: Models, Calibrations, Reconstructions, and Applications

Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System.

Multi-spectral Imaging System Based on Light Field Rendering

360 Deg Full-Parallax Light-Field Display Using Panoramic Camera

Research of real-time wide field image merging based on multi-cameras

Camera Array Based Light Field Microscopy

Design of a Novel Microlens Array and Imaging System for Light Fields

Light field angular super-resolution based on intrinsic and geometric information.

High-Resolution Light Field Cameras Based on A Hybrid Imaging System

Light field acquisition using a planar catadioptric system

A Structured-Light-Based Panoramic Depth Camera

High-resolution Light Field Reconstruction Using a Hybrid Imaging System

High Speed Large-Field-of-view Scanning Microscopy Imaging Technology and System Implementation

Meta Light Field Event Imaging System(Invited)

A Wide Field-of-View Light-Field Camera with Adjustable Multiplicity for Practical Applications