Abstract:The geometry-based light field compression approach aims to use the inherent disparity cue provided by the light field to reduce the redundancy of data and improve immersive media broadcasting. Some methods, including our previous one, transmit explicit disparity maps along with sparsely selected views and then exploit disparity-based view prediction to remove correlations in the angular domain. However, these methods neglect two important issues: the 4D correspondence between the disparity array and view array and the practical non-uniform disparity distribution in captured light fields. As a result, the prediction potentiality of disparity maps is heavily restricted, and the limited disparity-based prediction accuracy degrades the final compression performance. In this paper, we focus on these two issues of estimated disparity maps and propose a prediction-oriented disparity rectification (PoDR) model. First, based on our previous disparity estimation, we propose to utilize the 4D structural prior of light fields to refine the estimated disparity map. The 4D correspondence between a disparity array and a view array is enhanced, leading to higher prediction accuracy and lower bit costs. Second, for the refined disparity array, we propose a variable stride-based determination algorithm to obtain the practical non-uniform disparity distribution in captured light fields. Specifically, the angular distance between each pair of disparity maps is efficiently derived by the approximate solution based on the gradient variation of the prediction errors. By combining these two modules, the proposed PoDR model improves the overall compression performance compared with our previous work. Furthermore, we verify that the proposed method can obtain better light field fundamental capability (e.g., refocusing) than state-of-the-art methods.

Light Field Image Coding With Disparity Correlation Based Prediction

Light Field Image Coding Via Linear Approximation Prior.

Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction.

Light Field Image Compression Using Depth-Based Cnn In Intra Prediction

Light Field Compression With Disparity-Guided Sparse Coding Based on Structural Key Views

Light Field Image Compression Based on Quality Aware Pseudo-Temporal Sequence

Light Field Compression with Graph Learning and Dictionary-Guided Sparse Coding

4-D Epanechnikov Mixture Regression in Light Field Image Compression

Various density light field image coding based on distortion minimization interpolation *

Light Field Compression Using Global Multiplane Representation And Two-Step Prediction

Light field image coding using a residual channel attention network–based view synthesis

High Efficiency Light Field Compression Via Virtual Reference And Hierarchical Mv-Hevc

Light Field Multi-View Video Coding With Two-Directional Parallel Inter-View Prediction

Prediction-Oriented Disparity Rectification Model for Geometry-Based Light Field Compression

Pseudo Sequence Based 2-D Hierarchical Coding Structure for Light-Field Image Compression

OPTIMIZED INTER-VIEW PREDICTION BASED LIGHT FIELD IMAGE COMPRESSION WITH ADAPTIVE RECONSTRUCTION

Imaging-Correlated Intra Prediction for Plenoptic 2.0 Video Coding

An Integrated Representation & Compression Scheme Based on Convolutional Autoencoders with 4D DCT Perceptual Encoding for High Dynamic Range Light Fields

Pseudo-Sequence-Based Light Field Image Compression

Deep Decoding of $\ell_\infty$-coded Light Field Images

SIFT-based Adaptive Prediction Structure for Light Field Compression.