Abstract:Recently, deep learning-based computer-generated holography (CGH) has demonstrated tremendous potential in three-dimensional (3D) displays and yielded impressive display quality. However, most existing deep learning-based CGH techniques can only generate holograms of 1080p resolution, which is far from the ultra-high resolution (16K+) required for practical virtual reality (VR) and augmented reality (AR) applications to support a wide field of view and large eye box. One of the major obstacles in current CGH frameworks lies in the limited memory available on consumer-grade GPUs which could not facilitate the generation of higher-definition holograms. To overcome the aforementioned challenge, we proposed a divide-conquer-and-merge strategy to address the memory and computational capacity scarcity in ultra-high-definition CGH generation. This algorithm empowers existing CGH frameworks to synthesize higher-definition holograms at a faster speed while maintaining high-fidelity image display quality. Both simulations and experiments were conducted to demonstrate the capabilities of the proposed framework. By integrating our strategy into HoloNet and CCNNs, we achieved significant reductions in GPU memory usage during the training period by 64.3\% and 12.9\%, respectively. Furthermore, we observed substantial speed improvements in hologram generation, with an acceleration of up to 3$\times$ and 2 $\times$, respectively. Particularly, we successfully trained and inferred 8K definition holograms on an NVIDIA GeForce RTX 3090 GPU for the first time in simulations. Furthermore, we conducted full-color optical experiments to verify the effectiveness of our method. We believe our strategy can provide a novel approach for memory- and time-efficient holographic displays.

Accelerated generation of holograms with ultra-low memory symmetrically high-compressed look-up table

Rapid Algorithm for Computer-Generated Hologram of Three-Dimensional Object

Reduction on the Reconstruction Error of Computer-generated Holography in Liquid Crystal Panels

Convolutional Symmetric Compressed Look-Up-table Method for 360° Dynamic Color 3D Holographic Display.

Divide-Conquer-and-Merge: Memory- and Time-Efficient Holographic Displays

Computer-generated holographic near-eye display system based on LCoS phase only modulator

Redundancy elimination and high resolution algorithm for reconstruction of digital holograms

Holographic near-eye display system based on double-convergence light Gerchberg-Saxton algorithm.

Speckle Reduction by Macro-Pixel Separation Based on Double-Phase Holographic Display

Joint Neural Phase Retrieval and Compression for Energy- and Computation-Efficient Holography on the Edge

Effective CGH calculation algorithm with low memory usage using compressed look-up table based on separation of light modulation variable

Rapid Hologram Generation through Backward Ray Tracing and Adaptive-Resolution Wavefront Recording Plane

Improved Look-Up Table Method of Computer-Generated Holograms

Fast Hologram Generation Based on Parallel Computing

Gaze-contingent Efficient Hologram Compression for Foveated Near-Eye Holographic Displays.

Depth Compensating Calculation Method of Computer-Generated Holograms Using Symmetry and Similarity of Zone Plates

Data Compression Coding Technologies for Computer-Generated Holographic Three-Dimensional Display

Fast Hologram Generation for Active Holographic Display

Fast optimization of computer-generated holograms using conjugate gradient

Simple and Fast Calculation Algorithm for Computer-Generated Hologram Based on Integral Imaging Using Look-Up Table.

Graphics Processing Unit Accelerated Numerical Model for Collinear Holographic Data Storage System