Abstract:The estimation of depth from 4D light field images is a fundamental problem for perceiving and reconstructing environmental scenes. While learning-based methods have achieved remarkable results in this field, most of them rely on supervised learning, which faces significant challenges in real-world applications due to the lack of sufficient available ground truth depth maps. In this paper, we propose an unsupervised learning architecture based on a generative adversarial learning model for light field image depth estimation(OALFGAN). Specifically, our approach involves a multi-scale deep convolutional generative adversarial network learning system that includes a sparse-to-dense cascaded multi-scale generator and a discriminator, which decomposes the problem of generating high-quality images into more manageable sub-problems. To address the issue of violations of photometric consistency that may be caused by occlusion, we introduce a spatial-angular attention module that adaptively extracts view features with fewer occlusions and richer textures to generate more accurate disparity maps. Furthermore, we design a loss function that incorporates adaptive angular entropy consistency, symmetry loss, and edge-aware loss based on the distribution regularity and self-constraint of light field images to further optimize occlusion and disparity discontinuity issues and improve the reliability of the final depth prediction. Our proposed method demonstrates superior performance over existing methods on synthetic datasets, both quantitatively and qualitatively. Moreover, our proposed method exhibits excellent generalization performance on real-world datasets, demonstrating the effectiveness of our approach.

Cryptanalysis for a Light-Field 3D Cryptosystem Based on M-cGAN

3D medical images security via light-field imaging

Volumetric Light-field Encryption at the Microscopic Scale

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Multiple-image encryption based on light-field imaging and gravity model

A Double Color Image Encryption Scheme Based on Three-Dimensional Brownian Motion

Multiple Image Encryption Method Based on Light Field Imaging Theory and Chaotic System

Optical image encryption based on two-channel detection and deep learning

A Three-Dimensional Optical Image Cryptosystem Based on Integral Imaging.

A Deep Learning Based Attack for The Chaos-based Image Encryption

Multi-modal Spoofing Attacks on 3D Face Liveness Detection Via a Single 2D Photo

Private Image Reconstruction from System Side Channels Using Generative Models

An encrypted hiding scheme for 3D objects based on CGH and Henon mapping

An optical image encryption based on computational ghost imaging with sparse reconstruction

Deep learning decryption approach for asymmetric computer-generated holography (CGH) cryptosystem

Deep Decoding of $\ell_\infty$-coded Light Field Images

A 3D model encryption scheme based on a cascaded chaotic system

Three-dimensional Scene Encryption and Display Based on Computer-Generated Holograms.

Optical image encryption based on 3D double-phase encoding algorithm in the gyrator transform domain

Occlusion-aware Unsupervised Light Field Depth Estimation based on Muti-Scale GANs

Holographic Lensless Interference Encryption Based on Single Spatial Light Modulator.