Abstract:Holography stands at the forefront of visual technology, offering immersive, three‐dimensional visualizations through the manipulation of light wave amplitude and phase. Although generative models have been extensively explored in the image domain, their application to holograms remains relatively underexplored due to the inherent complexity of phase learning. Exploiting generative models for holograms offers exciting opportunities for advancing innovation and creativity, such as semantic‐aware hologram generation and editing. Currently, the most viable approach for utilizing generative models in the hologram domain involves integrating an image‐based generative model with an image‐to‐hologram conversion model, which comes at the cost of increased computational complexity and inefficiency. To tackle this problem, we introduce P‐Hologen, the first end‐to‐end generative framework designed for phase‐only holograms (POHs). P‐Hologen employs vector quantized variational autoencoders to capture the complex distributions of POHs. It also integrates the angular spectrum method into the training process, constructing latent spaces for complex phase data using strategies from the image processing domain. Extensive experiments demonstrate that P‐Hologen achieves superior quality and computational efficiency compared to the existing methods. Furthermore, our model generates high‐quality unseen, diverse holographic content from its learned latent space without requiring pre‐existing images. Our work paves the way for new applications and methodologies in holographic content creation, opening a new era in the exploration of generative holographic content. The code for our paper is publicly available on https://github.com/james0223/P-Hologen.

Holo-VQVAE: VQ-VAE for phase-only holograms

P‐Hologen: An End‐to‐End Generative Framework for Phase‐Only Holograms

All-optical Diffractive Neural Networked Terahertz Hologram.

Deep Learning Assisted Variational Hilbert Quantitative Phase Imaging

Non-iterative Phase Hologram Generation with Optimized Phase Modulation.

Generating Diverse High-Fidelity Images with VQ-VAE-2

Vision Transformer-Based, High-Fidelity, Computer-Generated Holography

Holographic-(V)AE: an end-to-end SO(3)-Equivariant (Variational) Autoencoder in Fourier Space

Digital phase-only holography using deep conditional generative models

Generating high-quality phase-only holograms of binary images using global loss and stochastic homogenization training strategy

High-efficiency generation of vectorial holograms with metasurfaces

DualVAE: Controlling Colours of Generated and Real Images

End-to-end learning of 3D phase-only holograms for holographic display

Generic Vectorial Hologram Based on Simultaneous and Independent Amplitude and Phase Modulation of Orthogonal Polarization States Via Single Completely Spin‐Decoupled Meta‐Particles

High-fidelity, Model-Driven Deep Learning Network for Phase-Only Computer-Generated Holography (conference Presentation)

Asymmetric Full-Color Vectorial Meta-holograms Empowered by Pairs of Exceptional Points.

Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators

Phase-probability shaping for speckle-free holographic lithography

Optimization Method to Construct Multiple Acoustic Vortices for Holograms

Weighted Iterative Algorithm For Phase Hologram Generation With High-Quality Reconstruction

3D Scattering-Enabled Vectorial Holographic Projection with a Binary Amplitude Hologram