Compact monocular 3D near-eye display

J Liu,Q Gao,J Han

DOI: https://doi.org/10.1364/3d.2017.dtu4f.2

2017-01-01

Abstract:Compact monocular 3D near-eye displays are proposed by using holographic waveguide combiner to reduce the weight and volume of its optical parts. The complex amplitude modulation technique is introduced to the system to solve the accommodation-convergence conflict of human eyes.

What problem does this paper attempt to address?

Holographic near-eye display system based on double-convergence light Gerchberg-Saxton algorithm.

Peng Sun,Shengqian Chang,Siqi Liu,Xiao Tao,Chang Wang,Zhenrong Zheng

DOI: https://doi.org/10.1364/OE.26.010140

IF: 3.8

2018-01-01

Optics Express

Abstract:In this paper. a method is proposed to implement noises reduced three-dimensional (3D) holographic near-eye display by phase-only computer-generated hologram (CGH). The CGH is calculated from a double-convergence light Gerchberg-Saxton (GS) algorithm, in which the phases of two virtual convergence lights are introduced into GS algorithm simultaneously. The first phase of convergence light is a replacement of random phase as the iterative initial value and the second phase of convergence light will modulate the phase distribution calculated by GS algorithm. Both simulations and experiments are carried out to verify the feasibility of the proposed method. The results indicate that this method can effectively reduce the noises in the reconstruction. Field of view (FOV) of the reconstructed image reaches 40 degrees and experimental light path in the 4-f system is shortened. As for 3D experiments, the results demonstrate that the proposed algorithm can present 3D images with 180cm zooming range and continuous depth cues. This method may provide a promising solution in future 3D augmented reality (AR) realization. (C) 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Metalens Eyepiece for 3D Holographic Near-Eye Display

Chang Wang,Zeqing Yu,Qiangbo Zhang,Yan Sun,Chenning Tao,Fei Wu,Zhenrong Zheng

DOI: https://doi.org/10.3390/nano11081920

IF: 5.3

2021-01-01

Nanomaterials

Abstract:Near-eye display (NED) systems for virtual reality (VR) and augmented reality (AR) have been rapidly developing; however, the widespread use of VR/AR devices is hindered by the bulky refractive and diffractive elements in the complicated optical system as well as the visual discomfort caused by excessive binocular parallax and accommodation-convergence conflict. To address these problems, an NED system combining a 5 mm diameter metalens eyepiece and a three-dimensional (3D), computer-generated holography (CGH) based on Fresnel diffraction is proposed in this paper. Metalenses have been extensively studied for their extraordinary capabilities at wavefront shaping at a subwavelength scale, their ultrathin compactness, and their significant advantages over conventional lenses. Thus, the introduction of the metalens eyepiece is likely to reduce the issue of bulkiness in NED systems. Furthermore, CGH has typically been regarded as the optimum solution for 3D displays to overcome limitations of binocular systems, since it can restore the whole light field of the target 3D scene. Experiments are carried out for this design, where a 5 mm diameter metalens eyepiece composed of silicon nitride anisotropic nanofins is fabricated with diffraction efficiency and field of view for a 532 nm incidence of 15.7% and 31 degrees, respectively. Furthermore, a novel partitioned Fresnel diffraction and resample method is applied to simulate the wave propagations needed to produce the hologram, with the metalens capable of transforming the reconstructed 3D image into a virtual image for the NED. Our work combining metalens and CGH may pave the way for portable optical display devices in the future.
3D holographic near-eye display based on Fraunhofer diffraction using metalens as an eyepiece

Zeqing Yu,Chang Wang,Lingmei Chen,Qin Xie,Xinyu Liu,Fei Wu,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2601069

2021-01-01

Abstract:Near-eye display (NED) systems for virtual reality (VR) and augmented reality (AR) have been rapidly developing. However, the conventional three-dimensional (3D) display methods are always disturbed by excessive binocular parallax and accommodation-convergence conflict. Although computer-generated holography (CGH) has recently experienced a renaissance for the ability of generating real 3D scenes, the widespread use of holographic VR/AR devices are limited by the bulky refractive and diffractive optics in the complicated optical system. To address these problems, a NED system combining the 3D CGH based on Fraunhofer diffraction and a metalens with a 5 mm diameter as an eyepiece is proposed in this paper. Based on the fact that metasurfaces are of substantial interest for their extraordinary capability of wavefront shaping in a subwavelength scale, the introducing of the metalens eyepiece surly facilitates lightening the CGH-NED systems. Experiments are carried out for this design, where Fraunhofer diffraction with digital lens phases of different focal lengths are applied to simulate the wave propagations to produce computer-generated hologram, and the metalens transforms the holographic reconstructed 3D image into virtual image to realize NED. In the experiment, the metalens eyepiece composed of silicon nitride anisotropic nanofins is fabricated with the diffraction efficiency and field of view for 532 nm incidence of 15.7% and 31 degrees, respectively. Our work combining of CGH and metalens may provide a promising solution in future for computer-generated holographic 3D portable display device realization.
The adARC pattern analysis architecture for adaptive human activity recognition systems

D. Roggen,Kilian Förster,Alberto Calatroni,G. Tröster

DOI: https://doi.org/10.1007/s12652-011-0064-0

IF: 3.662

2011-08-18

Journal of Ambient Intelligence and Humanized Computing

Abstract:
Computer-generated holographic near-eye display system based on LCoS phase only modulator

Peng Sun,Shengqian Chang,Siman Zhang,Ting Xie,Huaye Li,Siqi Liu,Chang Wang,Xiao Tao,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2271730

2017-01-01

Abstract:Augmented reality (AR) technology has been applied in various areas, such as large-scale manufacturing, national defense, healthcare, movie and mass media and so on. An important way to realize AR display is using computer-generated hologram (CGH), which is accompanied by low image quality and heavy computing defects. Meanwhile, the diffraction of Liquid Crystal on Silicon (LCoS) has a negative effect on image quality. In this paper, a modified algorithm based on traditional Gerchberg-Saxton (GS) algorithm was proposed to improve the image quality, and new method to establish experimental system was used to broaden field of view (FOV). In the experiment, undesired zero-order diffracted light was eliminated and high definition 2D image was acquired with FOV broadened to 36.1 degree. We have also done some pilot research in 3D reconstruction with tomography algorithm based on Fresnel diffraction. With the same experimental system, experimental results demonstrate the feasibility of 3D reconstruction. These modifications are effective and efficient, and may provide a better solution in AR realization.
Holographic three-dimensional display based on shifted Fraunhofer diffraction

Peng Sun,Zeqing Yu,Chenning Tao,Siqi Liu,Xiao Tao,Chang Wang,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2573430

2020-01-01

Abstract:Holographic display has attracted considerable attention for its high-contrast, low power consumption, wide color gamut and potentials for three-dimensional (3D) display. Although computer-generated hologram (CGH) has the potential for reconstructing all the 3D information of an object, complicated 3D modeling and time-consuming computation are big challenges faced by current 3D holographic display. A simple yet effective method to realize holographic 3D display by shifted Fraunhofer diffraction has been presented in this paper. After a 3D object is divided into a set of layers in axial direction, these layers are calculated into corresponding sub-holograms by Fraunhofer diffraction. The hologram uploaded on SLM consists of sub-holograms in a tiling approach. Both simulations and experiments are carried out to verify the feasibility of shifted Fraunhofer diffraction. Detailed analysis of computational cost has also been carried out, and the comparison between shifted Fresnel diffraction and shifted Fraunhofer diffraction in the proposed method has been analyzed. The Analysis results shows that the process of 3D modeling is simple, that is the computational complexity is accordingly reduced compared with shifted Fraunhofer diffraction. The experimental results demonstrate that our method can reconstruct multi-plane 3D object with continuous depth map. It is expected that the proposed method may provide a better solution in future holographic 3D display research.
Holographic Three-Dimensional Display Based on Optimizing Arrangement of Holograms

Peng Sun,Chenning Tao,Jinlei Zhang,Rengmao Wu,Siqi Liu,Qinzhen Tao,Chang Wang,Fei Wu,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.optcom.2020.125260

IF: 2.4

2020-01-01

Optics Communications

Abstract:We present a simple yet effective method to realize holographic three-dimensional (3D) display by optimizing arrangement of holograms. After a 3D object is divided into a set of layers in axial direction, these layers are calculated into corresponding sub-holograms by Fraunhofer diffraction. The hologram uploaded on SLM consists of sub-holograms side-by-side. Both simulations and experiments are carried out to verify the feasibility of the proposed method. The difference between Fresnel diffraction and Fraunhofer diffraction in the proposed method is analyzed. Aiming at the problems exposed in the experiments, reconstructed results are discussed and further improved by optimizing arrangement of sub-holograms. The process of 3D modeling is simple and the computational complexity is accordingly reduced. This method may provide a promising solution in future holographic 3D realization.
Waveguide holography for 3D augmented reality glasses

Changwon Jang,Kiseung Bang,Minseok Chae,Byoungho Lee,Douglas Lanman

DOI: https://doi.org/10.1038/s41467-023-44032-1

IF: 16.6

2024-01-02

Nature Communications

Abstract:Abstract Near-eye displays are fundamental technology in the next generation computing platforms for augmented reality and virtual reality. However, there are remaining challenges to deliver immersive and comfortable visual experiences to users, such as compact form factor, solving vergence-accommodation conflict, and achieving a high resolution with a large eyebox. Here we show a compact holographic near-eye display concept that combines the advantages of waveguide displays and holographic displays to overcome the challenges towards true 3D holographic augmented reality glasses. By modeling the coherent light interactions and propagation via the waveguide combiner, we demonstrate controlling the output wavefront using a spatial light modulator located at the input coupler side. The proposed method enables 3D holographic displays via exit-pupil expanding waveguide combiners, providing a large software-steerable eyebox. It also offers additional advantages such as resolution enhancement capability by suppressing phase discontinuities caused by pupil replication process. We build prototypes to verify the concept with experimental results and conclude the paper with discussion.

multidisciplinary sciences
Waveguide-Based Binocular Maxwellian Near-Eye Display Employing a Single Micro-Display and Polarization Grating

Myeong-Ho Choi,Minseong Kim,Kwang-Soo Shin,Jisoo Hong,Jae-Hyeung Park

DOI: https://doi.org/10.1109/jstqe.2024.3369692

IF: 4.9

2024-01-01

IEEE Journal of Selected Topics in Quantum Electronics

Abstract:In this article, we propose a waveguide-based binocular Maxwellian near-eye display for implementing realistic augmented reality. Contrasting with conventional binocular near-eye displays that typically use two micro-displays, our proposed configuration uniquely utilizes a single micro-display to present binocular images. The key optical component in our design is a polarization-dependent grating that deflects incident light to different directions depending on its circular polarization state. Additionally, by using a non-conventional out-coupler, namely, a pin-mirror holographic optical element array, we address the vergence-accommodation conflict issue, which is a primary cause of visual discomfort in conventional near-eye displays. The field of view enhancement by using a set of pin-mirror holographic optical elements is also demonstrated.

engineering, electrical & electronic,optics,physics, applied,quantum science & technology
Binocular full-color holographic three-dimensional near eye display using a single SLM

Shu-Feng Lin,Shi-Hang Zhang,Jie Zhao,Lu Rong,Yunxin Wang,Dayong Wang

DOI: https://doi.org/10.1364/OE.480062

2023-01-16

Abstract:A binocular full-color holographic three-dimensional near eye display system using a single spatial light modulator (SLM) is proposed. In the display system, the frequency spectrum shifting operation and color spectrum shifting operation are adopted to realize the frequency division multiplexing (FDM) and frequency superposition multiplexing (FSM) by manipulating the frequency spectrums of each color- and view-channel sub-holograms. The FDM combined with polarization multiplexing will be used to implement binocular display using a single SLM, and the FSM working with a bandpass filter for each view-channel will be used to achieve full-color display from single frame hologram. The optical analysis and experiments with 3D color objects confirm the feasibility of the proposed system in the practical application.
Large-scale Huygens metasurfaces for holographic 3D near-eye displays

Weitao Song,Xinan Liang,Shiqiang Li,Dongdong Li,Ramon Paniagua-Dominguez,Keng Heng Lai,Qunying Lin,Yuanjin Zheng,Arseniy I. Kuznetsov

DOI: https://doi.org/10.1002/lpor.202000538

2020-10-09

Abstract:Novel display technologies aim at providing the users with increasingly immersive experiences. In this regard, it is a long-sought dream to generate three-dimensional (3D) scenes with high resolution and continuous depth, which can be overlaid with the real world. Current attempts to do so, however, fail in providing either truly 3D information, or a large viewing area and angle, strongly limiting the user immersion. Here, we report a proof-of-concept solution for this problem, and realize a compact holographic 3D near-eye display with a large exit pupil of 10mm x 8.66mm. The 3D image is generated from a highly transparent Huygens metasurface hologram with large (>10^8) pixel count and subwavelength pixels, fabricated via deep-ultraviolet immersion photolithography on 300 mm glass wafers. We experimentally demonstrate high quality virtual 3D scenes with ~50k active data points and continuous depth ranging from 0.5m to 2m, overlaid with the real world and easily viewed by naked eye. To do so, we introduce a new design method for holographic near-eye displays that, inherently, is able to provide both parallax and accommodation cues, fundamentally solving the vergence-accommodation conflict that exists in current commercial 3D displays.

Optics
Optical mapping near-eye three-dimensional display with correct focus cues

Wei Cui,Liang Gao

DOI: https://doi.org/10.1364/ol.42.002475

IF: 3.6

2017-06-21

Optics Letters

Abstract:We present an optical mapping near-eye (OMNI) three-dimensional display method for wearable devices. By dividing a display screen into different subpanels and optically mapping them to various depths, we create a multiplane volumetric image with correct focus cues for depth perception. The resultant system can drive the eye's accommodation to the distance that is consistent with binocular stereopsis, thereby alleviating the vergence-accommodation conflict, the primary cause for eye fatigue and discomfort. Compared with the previous methods, the OMNI display offers prominent advantages in adaptability, image dynamic range, and refresh rate.

optics
Holographic Near-eye Display with Phase-space Synthesis

Jiasheng Xiao,Runze Zhu,Hao Zhang

DOI: https://doi.org/10.1364/dh.2024.tu1b.4

2024-01-01

Abstract:A holographic near-eye display based on the phase-space synthesis technique is proposed. An optimization-free algorithm for hologram generation is developed. Realistic 3D display accompanied by natural defocus blur are verified.
Binocular near-eye augmented reality enabled by full utilization of functional computer generated hologram

Xiaoming Huang,Yongle Zhou,Haowen Liang,Jianying Zhou

DOI: https://doi.org/10.1016/j.optlaseng.2024.108115

IF: 5.666

2024-05-01

Optics and Lasers in Engineering

Abstract:A novel scheme is proposed for constructing binocular near-eye displays for augmented reality (AR) using the Maxwellian view and computer-generated hologram technology. The aim is to provide parallax holographic images with a large depth of focus for both eyes. This is achieved by employing a phase-only spatial light modulator to generate two holographic axicon phases. By utilizing the proposed holographic AR, based on the Maxwellian near-eye display method, the issue of vergence-accommodation conflict can be effectively eliminated. Additionally, the eyebox range of the proposed AR can be further expanded by implementing the eye tracking method to shift the focusing of the axicon phases. To showcase the feasibility of this AR near-eye display, a prototype system is developed, offering a virtual stereoscopic three-dimensional display in conjunction with the real world.

optics
Compact Stereo Waveguide Display Based on a Unidirectional Polarization-Multiplexed Metagrating In-Coupler

Zeyang Liu,Cheng Zhang,Wenqi Zhu,Zhanhua Huang,Henri J. Lezec,Amit Agrawal,L. Jay Guo

DOI: https://doi.org/10.1021/acsphotonics.0c01885

IF: 7

2021-03-22

ACS Photonics

Abstract:Three-dimensional (3D) vision in augmented reality (AR) displays can enable highly immersive and realistic viewer experience, hence, attracts much attention. Most current approaches create 3D vision by projecting stereoscopic images to different eyes using two separate projection systems, which are inevitably bulky for wearable devices. Here, we propose a compact stereo waveguide AR display system using a single piece of thin flat glass integrated with a polarization-multiplexed metagrating in-coupler and two diffractive grating out-couplers. Incident light of opposite circular polarization states carrying stereoscopic images are first steered by the metagrating in-coupler to opposite propagation directions in the flat glass waveguide, subsequently extracted by the diffractive grating out-couplers, and finally received by different eyes, forming 3D stereo vision. Experimentally, we fabricated a display prototype and demonstrated independent projection of two polarization-multiplexed stereoscopic images. This work paves a novel path toward the implementation of high-performance stereo displays with compact size, lightweight, and multicolor compatibility.The Supporting Information is available free of charge at <a class="ext-link" href="/doi/10.1021/acsphotonics.0c01885?goto=supporting-info">https://pubs.acs.org/doi/10.1021/acsphotonics.0c01885</a>.Stacking two layers of waveguides for multicolor stereo display (<a class="ext-link" href="/doi/suppl/10.1021/acsphotonics.0c01885/suppl_file/ph0c01885_si_001.pdf">PDF</a>)This article has not yet been cited by other publications.

physics, condensed matter,optics, applied,materials science, multidisciplinary,nanoscience & nanotechnology
Method of Concave Pin-mirror for Near-eye Display

Mao Fan,Binghua Wu,Hao Zhang

DOI: https://doi.org/10.1364/3d.2020.jth2a.25

2020-01-01

Abstract:Near-eye augmented reality display is one of the hot topics which has developed rapidly in recent years. Currently, various optical display systems couldn’t meet the requirements with the light, convenience, large field of view for near-eye head-mounted display. We present a method of concave pin-mirror for near-eye augmented reality display based on the simple concave reflective mirror and pinhole imaging. This whole system has the same size as normal glasses, and it it convenient, as well as the field of view reaching 88°. The proposed method provides a new idea for future near-eye display.
Holographic Maxwellian near-eye display with adjustable and continuous eye-box replication

Shijie Zhang,Juan Liu,Zhiqi Zhang

DOI: https://doi.org/10.48550/arXiv.2106.06226

2021-06-11

Abstract:The Maxwellian display presents always-focused images to the viewer, alleviating the vergence-accommodation conflict (VAC) in near-eye displays (NEDs). However, the limited eyebox of the typical Maxwellian display prevents it from wider applications. We propose a holographic Maxwellian near-eye display with adjustable and continuous eye-box replication. Holographic display provides a way to match the human pupil size with the interval of the replicated eyeboxes, making it possible to eliminate or alleviate double image or blind area problem, which exists long in eyebox expansion for Maxwellian display. Besides, seamless image conversion between viewing points has been achieved through hologram pre-processing. Optical experiment confirms that the interval between replicated eyeboxes is dynamically adjustable, ranging from 2mm to 6mm. The proposed display can present always-focused images and seamless conversion among viewpoints with 5.32$^\circ$ horizontal field of view, and 9mmH * 3mmV eyebox.

Optics,Image and Video Processing
Three-dimensional Display with a Multi-Directional Backlight

Zi-yin Li,Hai-feng Li,Xu Liu

DOI: https://doi.org/10.37188/cjlcd.2022-0031

2022-01-01

Abstract:To realize three-dimensional(3D) images with low crosstalk, full resolution, and multi-view, a 3D display based on a multi-directional backlight is proposed. An eye-tracker in the system is used to acquire the position of human eyes and feedback to multi-directional backlight and the liquid crystal display (LCD) panel. Directional parallax images are time-sequentially provided to each eye by simultaneously working of multi-directional backlight and LCD screen. Viewers can achieve 3D perception based on the persistence of vision. Multi-directional backlight is mainly realized by a series of cylindrical waves and a holographic optical element (HOE). Different cylindrical waves produce diffracted beams in different directions through HOE. Double-LED type and diffuser type are proposed to improve the uniformity of the proposed system. Experimental results indicate that this system can provide full resolution 3D images in 25 viewing zones, and the uniformity is improved to 80% average crosstalk is as low as 2.75% , which satisfy the demands for crosstalk, resolution, uniformity in the 3D display system, and the visual experience of viewers is greatly improved.
Concave Pin-Mirror for Near-Eye Display

Mao Fan,Binghua Wu,Yongfeng Yu,Shenhao Zhao,Hao Zhang,Haiqing Liu

DOI: https://doi.org/10.1016/j.ijleo.2021.166976

IF: 3.1

2021-01-01

Optik

Abstract:Near-eye augmented reality display is a promising technology which has developed rapidly in recent years. We present a concave pin-mirror for near-eye display based on the simple concave reflective mirror. This whole system has the same size as the normal glasses, with the field of view theoretically reaching 88°, as well as its prototype of 48°. The proposed system can meet the requirements with the light, convenience, large field of view for near-eye display. It is expected that our proposed method provides a new view for future near-eye display.
Design, analysis and optimization of a waveguide-type near-eye display using a pin-mirror array and a concaved reflector

Qingtian Zhang,Yongri Piao,Shining Ma,Yue Liu,Yongtian Wang,Weitao Song

DOI: https://doi.org/10.1364/OE.469828

2022-08-29

Abstract:Waveguides have become one of the most promising optical combiners for see-through near-eye displays due to the thickness, weight, and transmittance. In this study, we propose a waveguide-type near-eye display using a pin-mirror array and a concaved reflector with a compact outlook, optimized image uniformity and stray light. Issues have been discussed in detail, which include field of view (FOV), eye-box, resolution, depth of field (DOF), display uniformity and stray light artifacts. It can be shown that the DOF can be extended (when compared with traditional waveguide-type near-eye displays) to alleviate the vergence-accommodation conflict (VAC) problem, and the uniformity & stray light can be improved with an optimal structure. Moreover, reflective surfaces have been introduced as the input and output coupling with a compact outlook, an easy-processing structure and the achromatic performance. A prototype based on the proposed method have been successfully developed, and virtual images with an extended DOF can be shown along with the real-world.

Compact monocular 3D near-eye display

Holographic near-eye display system based on double-convergence light Gerchberg-Saxton algorithm.

Metalens Eyepiece for 3D Holographic Near-Eye Display

3D holographic near-eye display based on Fraunhofer diffraction using metalens as an eyepiece

The adARC pattern analysis architecture for adaptive human activity recognition systems

Computer-generated holographic near-eye display system based on LCoS phase only modulator

Holographic three-dimensional display based on shifted Fraunhofer diffraction

Holographic Three-Dimensional Display Based on Optimizing Arrangement of Holograms

Waveguide holography for 3D augmented reality glasses

Waveguide-Based Binocular Maxwellian Near-Eye Display Employing a Single Micro-Display and Polarization Grating

Binocular full-color holographic three-dimensional near eye display using a single SLM

Large-scale Huygens metasurfaces for holographic 3D near-eye displays

Optical mapping near-eye three-dimensional display with correct focus cues

Holographic Near-eye Display with Phase-space Synthesis

Binocular near-eye augmented reality enabled by full utilization of functional computer generated hologram

Compact Stereo Waveguide Display Based on a Unidirectional Polarization-Multiplexed Metagrating In-Coupler

Method of Concave Pin-mirror for Near-eye Display

Holographic Maxwellian near-eye display with adjustable and continuous eye-box replication

Three-dimensional Display with a Multi-Directional Backlight

Concave Pin-Mirror for Near-Eye Display

Design, analysis and optimization of a waveguide-type near-eye display using a pin-mirror array and a concaved reflector