Abstract:Focused plenoptic cameras can record spatial and angular information of the light field (LF) simultaneously with higher spatial resolution relative to traditional plenoptic cameras, which facilitate various applications in computer vision. However, the existing plenoptic image compression methods present ineffectiveness to the captured images due to the complex micro-textures generated by the microlens relay imaging and long-distance correlations among the microimages. In this paper, a lossy end-to-end learning architecture is proposed to compress the focused plenoptic images efficiently. First, a data preprocessing scheme is designed according to the imaging principle to remove the sub-aperture image ineffective pixels in the recorded light field and align the microimages to the rectangular grid. Then, the global attention module with large receptive field is proposed to capture the global correlation among the feature maps using pixel-wise vector attention computed in the resampling process. Also, a new image dataset consisting of 1910 focused plenoptic images with content and depth diversity is built to benefit training and testing. Extensive experimental evaluations demonstrate the effectiveness of the proposed approach. It outperforms intra coding of HEVC and VVC by an average of 62.57% and 51.67% bitrate reduction on the 20 preprocessed focused plenoptic images, respectively. Also, it achieves 18.73% bitrate saving and generates perceptually pleasant reconstructions compared to the state-of-the-art end-to-end image compression methods, which benefits the applications of focused plenoptic cameras greatly. The dataset and code are publicly available at https://github.com/VincentChandelier/GACN.

5-D Epanechnikov Mixture-of-Experts in Light Field Image Compression

4-D Epanechnikov Mixture Regression in Light Field Image Compression

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Image Reshaping for Efficient Compression of Plenoptic Content

Low-complexity ℓ∞-Compression of Light Field Images with a Deep-Decompression Stage

Learning Kernel-Modulated Neural Representation for Efficient Light Field Compression

End-to-End Light Field Image Compression with Multi-Domain Feature Learning

Plenoptic Image Compression Based on Linear Transformation and Interpolation

Light Field Compression Based on Implicit Neural Representation

Two-pass Light Field Image Compression for Spatial Quality and Angular Consistency.

Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction.

Low Bitrate Light Field Compression with Geometry and Content Consistency

Data Compression of Light Field Using Multiscale Edges

Light Field Image Coding Via Linear Approximation Prior.

Three-dimensional Epanechnikov mixture regression in image coding

Light Field Image Compression Using Generative Adversarial Network-Based View Synthesis

Lenselet Image Compression Scheme Based on Subaperture Images Streaming

Light Field Image Compression Based on Quality Aware Pseudo-Temporal Sequence

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

Learned Focused Plenoptic Image Compression with Microimage Preprocessing and Global Attention