Neural Étendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display
Ethan Tseng,Grace Kuo,Seung-Hwan Baek,Nathan Matsuda,Andrew Maimone,Florian Schiffers,Praneeth Chakravarthula,Qiang Fu,Wolfgang Heidrich,Douglas Lanman,Felix Heide
DOI: https://doi.org/10.1038/s41467-024-46915-3
2024-04-27
Abstract:Holographic displays can generate light fields by dynamically modulating the wavefront of a coherent beam of light using a spatial light modulator, promising rich virtual and augmented reality applications. However, the limited spatial resolution of existing dynamic spatial light modulators imposes a tight bound on the diffraction angle. As a result, modern holographic displays possess low étendue, which is the product of the display area and the maximum solid angle of diffracted light. The low étendue forces a sacrifice of either the field-of-view (FOV) or the display size. In this work, we lift this limitation by presenting neural étendue expanders. This new breed of optical elements, which is learned from a natural image dataset, enables higher diffraction angles for ultra-wide FOV while maintaining both a compact form factor and the fidelity of displayed contents to human viewers. With neural étendue expanders, we experimentally achieve 64$\times$ étendue expansion of natural images in full color, expanding the FOV by an order of magnitude horizontally and vertically, with high-fidelity reconstruction quality (measured in PSNR) over 29 dB on retinal-resolution images.
Image and Video Processing,Computer Vision and Pattern Recognition,Optics