Abstract:Recent imaging technologies are rapidly evolving for sampling richer and more immersive representations of the 3D world. One of the emerging technologies is light field (LF) cameras based on micro-lens arrays. To record the directional information of the light rays, a much larger storage space and transmission bandwidth are required by an LF image as compared with a conventional 2D image of similar spatial dimension. Hence, the compression of LF data becomes a vital part of its application. In this paper, we propose an LF codec with disparity guided Sparse Coding over a learned perspective-shifted LF dictionary based on selected Structural Key Views (SC-SKV). The sparse coding is based on a limited number of optimally selected SKVs; yet the entire LF can be recovered from the coding coefficients. By keeping the approximation identical between encoder and decoder, only the residuals of the non-key views, disparity map, and the SKVs need to be compressed into the bit stream. An optimized SKV selection method is proposed such that most LF spatial information can be preserved. To achieve optimum dictionary efficiency, the LF is divided into several coding regions, over which the reconstruction works individually. Experiments and comparisons have been carried out over benchmark LF data set, which show that the proposed SC-SKV codec produces convincing compression results in terms of both rate-distortion performance and visual quality compared with Joint Exploration Model: with 37.9% BD-rate reduction and 1.17-dB BD-PSNR improvement achieved on average, especially with up to 6-dB improvement for low bit rate scenarios.

SIFT-based Adaptive Prediction Structure for Light Field Compression.

Feature Based Inter Prediction Optimization for Non-Translational Video Coding in Cloud

Pseudo Sequence Based 2-D Hierarchical Coding Structure for Light-Field Image Compression

Light Field Image Compression Using Depth-Based Cnn In Intra Prediction

Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction.

OPTIMIZED INTER-VIEW PREDICTION BASED LIGHT FIELD IMAGE COMPRESSION WITH ADAPTIVE RECONSTRUCTION

Light Field Compression With Disparity-Guided Sparse Coding Based on Structural Key Views

Pseudo-Sequence-Based Light Field Image Compression

Color Light Field Block Truncation Compression Using Hierarchical Bit-Plane Prediction

Dynamic Light Field Compression Using Shared Fields and Region Blocks for Streaming Service.

Data Compression of Light Field Using Multiscale Edges

Two-pass Light Field Image Compression for Spatial Quality and Angular Consistency.

4-D Epanechnikov Mixture Regression in Light Field Image Compression

Adaptive Local Block Truncating Light Field Coding

Fast Stereoscopic Frame Estimation and Interpolation Algorithm in Compressed Stereo Video Streams

Light field image coding using a residual channel attention network–based view synthesis

SIFT-Based Image Compression

Light Field Image Compression Based on Deep Learning

Adaptive Prediction Structure for Learned Video Compression

Shearlet Transform based Light Field Compression Under Low Bitrates

Light Field Image Compression Using Generative Adversarial Network-Based View Synthesis