Abstract:In recent years there has been an increasing interest in sensing devices that capture multidimensional information such as the spectral light field (SLF) images, which are 5-dimensional (5D) representations of a scene including 2D spatial, 2D angular and 1D spectral information. Spatio-spectral and angular information plays an important role in modern applications spanning from microscopy to computer vision. However, SLF sensors use expensive beam-splitters or cameras arrays placed in tandem, which split the sensing problem in two time consuming and independent tasks: spectral and light field imaging tasks. This work proposes a compressive spectral light field imaging architecture that builds on the principles of the compressive imaging framework, to capture multiplexed representations of the multidimensional information, so that, less measurements are required to capture the SLF data cube. Alongside, we propose a computational algorithm to recover the 5D information from the compressed measurements, exploiting the inherent high correlations within the SLF by treating them as 3D tensors. Furthermore, exploiting the geometry properties of the proposed optical architecture, the Tucker decomposition is applied to the set of compressed measurements, so that, an ad-hoc dictionary-like image representation basis is calculated online. This in turn, entails a more accurate reconstruction of the SLF since the dictionary fits the specific characteristics of the image itself. We demonstrate through simulations over three SLF datasets captured in our laboratory, and an experimental proof-of-concept implementation, that the proposed compressive imaging device together with the proposed computational algorithm represent an efficient alternative to capture SLF, compared to conventional methods that employ either side-information or multiple sensors. Also, we show that the tensor-based proposed algorithm exhibits a lower computational complexity than the matrix-based state of the -rt counterparts, thus enabling fast processing of multidimensional images.

A Framework for Surface Light Field Compression

Surface Light Field Compression Using a Point Cloud Codec

Low Bitrate Light Field Compression with Geometry and Content Consistency

Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction.

Light Field Compression with Graph Learning and Dictionary-Guided Sparse Coding

Light Field Compression With Disparity-Guided Sparse Coding Based on Structural Key Views

Light Field Image Compression Using Generative Adversarial Network-Based View Synthesis

Light Field Video Compression and Real Time Rendering

Image-based Compression, Prioritized Transmission and Progressive Rendering of Circular Light Fields (CLFS) for Ancient Chinese Artifacts

Data Compression of Light Field Using Multiscale Edges

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Compressive Spectral Light Field Image Reconstruction via Online Tensor Representation

Light field angular super-resolution based on intrinsic and geometric information.

Learning a Compact Spatial-Angular Representation for Light Field

Shearlet Transform based Light Field Compression Under Low Bitrates

Dynamic Light Field Compression Using Shared Fields and Region Blocks for Streaming Service.

Scene Surface Light Field Representation for Realistic Lighting

24.2: Real‐Time Rendering 360° Floating Light‐Field 3D Display

Learning Kernel-Modulated Neural Representation for Efficient Light Field Compression

Low-complexity ℓ∞-Compression of Light Field Images with a Deep-Decompression Stage

Light Field Image Coding Via Linear Approximation Prior.