Abstract:Current learning-based Computer-Generated Holography (CGH) algorithms often utilize Convolutional Neural Networks (CNN)-based architectures. However, the CNN-based non-iterative methods mostly underperform the State-Of-The-Art (SOTA) iterative algorithms such as Stochastic Gradient Descent (SGD) in terms of display quality. Inspired by the global attention mechanism of Vision Transformer (ViT), we propose a novel unsupervised autoencoder-based ViT for generating phase-only holograms. Specifically, for the encoding part, we use Uformer to generate the holograms. For the decoding part, we use the Angular Spectrum Method (ASM) instead of a learnable network to reconstruct the target images. To validate the effectiveness of the proposed method, numerical simulations and optical reconstructions are performed to compare our proposal against both iterative algorithms and CNN-based techniques. In the numerical simulations, the PSNR and SSIM of the proposed method are 26.78 dB and 0.832, which are 4.02 dB and 0.09 higher than that of the CNN-based method, respectively. Moreover, the proposed method contains less speckles and features a higher display quality than other CGH methods in experiments. We suggest the improvement might be ascribed to the ViT’s global attention mechanism, which is more suitable for learning the cross-domain mapping from image (spatial) domain to hologram (Fourier) domain. We believe the proposed ViT-based CGH algorithm could be a promising candidate for future real-time high-fidelity holographic displays.

Computer-generated Hologram Compression with Attention-Based Deep Convolutional Neural Network

Method for Computer-Generated Hologram Compression with Attention Based Quantum Inspired Neural Network

Fast transmission of computer-generated hologram with compressed sensing and quantum-inspired neural network

Information Compression of Computer-Generated Hologram Using BP Neural Network

Computational ghost imaging with deep compressed sensing

Gaze-contingent Efficient Hologram Compression for Foveated Near-Eye Holographic Displays.

Real-time High-Quality Computer-Generated Hologram Using Complex-Valued Convolutional Neural Network

Method of Computer-Generated Hologram Compression and Transmission Using Quantum Back-Propagation Neural Network

Efficient Computer-Generated Holography Based on Mixed Linear Convolutional Neural Networks

High-speed Computer-Generated Holography Using an Autoencoder-Based Deep Neural Network

Vision Transformer-Based, High-Fidelity, Computer-Generated Holography

End-to-end Compression-Aware Computer-Generated Holography.

Computer-Generated Hologram Fast Transmission Using Compressive Sensing

Model-driven Neural Network for Compressive Holographic Reconstruction

Optimized Initial Weight in Quantum-Inspired Neural Network for Compressing Computer-Generated Holograms

3D information transmission of a computer-generated hologram using a quantum compensation hybrid neural network

High-fidelity, Model-Driven Deep Learning Network for Phase-Only Computer-Generated Holography (conference Presentation)

Compression of phase-only holograms with JPEG standard and deep learning

Real-time 4K computer-generated hologram based on encoding conventional neural network with learned layered phase

Progress of the Computer-Generated Holography Based on Deep Learning

Unsupervised Fourier-inspired neural network for real-time and high-fidelity computer-generated holography