Waveguide holography for 3D augmented reality glasses

Changwon Jang,Kiseung Bang,Minseok Chae,Byoungho Lee,Douglas Lanman

DOI: https://doi.org/10.1038/s41467-023-44032-1

IF: 16.6

2024-01-02

Nature Communications

Abstract:Abstract Near-eye displays are fundamental technology in the next generation computing platforms for augmented reality and virtual reality. However, there are remaining challenges to deliver immersive and comfortable visual experiences to users, such as compact form factor, solving vergence-accommodation conflict, and achieving a high resolution with a large eyebox. Here we show a compact holographic near-eye display concept that combines the advantages of waveguide displays and holographic displays to overcome the challenges towards true 3D holographic augmented reality glasses. By modeling the coherent light interactions and propagation via the waveguide combiner, we demonstrate controlling the output wavefront using a spatial light modulator located at the input coupler side. The proposed method enables 3D holographic displays via exit-pupil expanding waveguide combiners, providing a large software-steerable eyebox. It also offers additional advantages such as resolution enhancement capability by suppressing phase discontinuities caused by pupil replication process. We build prototypes to verify the concept with experimental results and conclude the paper with discussion.

multidisciplinary sciences

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to develop a compact holographic near - eye display system, combining the advantages of waveguide displays and holographic displays, in order to overcome the challenges faced by existing augmented reality (AR) glasses in providing an immersive and comfortable visual experience. Specifically, this research aims to solve the following key issues:

1. **Compact Design**: Existing AR glasses are often bulky and not convenient for carrying and long - term wearing. This paper proposes a compact display concept based on waveguide holographic technology, aiming to achieve a smaller form factor and improve portability and comfort.

2. **Solve the Vergence - Accommodation Conflict (VAC)**: VAC is a major problem in AR glasses, that is, the user's eyes need to focus on different distances simultaneously, which will lead to visual fatigue. By combining the advantages of waveguide displays and holographic displays, this research attempts to generate natural focus cues, thereby solving the VAC problem.

3. **High Resolution and Large Field of View**: Existing AR glasses are usually limited by resolution and field of view. The system proposed in this paper improves the resolution by suppressing phase discontinuities (caused by the pupil replication process), and achieves a large field of view through the exit - pupil expanding (EPE) waveguide combiner.

4. **Dynamic Holographic Display**: Traditional waveguide displays can only display images at a fixed depth, while the system proposed in this paper can control the output wavefront through a spatial light modulator (SLM) to achieve dynamic holographic display and provide a real 3D visual experience.

5. **Software - Controllable Eyebox**: Traditional waveguide displays require mechanical adjustment to match the position of the user's pupil, while the system proposed in this paper achieves a large - range eyebox through software control without mechanical adjustment.

To achieve the above goals, the researchers developed a new waveguide holographic display architecture. By accurately modeling the propagation and interaction of coherent light in the waveguide, and using a multi - channel convolution model and complex apertures to control the output wavefront. Experimental results show that this system can achieve high - quality 3D holographic display in a compact design, with a large eyebox and high resolution.

### Formula Explanation
Several key formulas mentioned in the paper are as follows:

1. **Angular Resolution of Waveguide**:
\[
\delta\theta_{\text{res}} = \frac{\lambda}{2t \tan \theta_T}
\]
where:
- \(\lambda\) is the wavelength of monochromatic light.
- \(t\) is the thickness of the substrate.
- \(\theta_T\) is the field - of - view component of the total internal reflection (TIR) angle.

2. **Loss Function**:
\[
L = \left\| u_0(x, y) / C_0 - u(x, y) \right\|_1
\]
where:
- \(u_0(x, y)\) is the measured complex field.
- \(C_0\) is the normalization constant.
- \(u(x, y)\) is the estimated complex field.
- \(\left\| \cdot \right\|_1\) represents the L1 norm.

These formulas are used in the paper to describe the physical characteristics of the waveguide and the loss function of model training, ensuring the performance and accuracy of the system.