A High-Accuracy Visual Simulation Method for Light Field 3D Display

Xiao-Shuai Hu,Tong-Yu Wang,Xing-Yu Lin,Han-Le Zhang,Qiong-Hua Wang,Yan Xing

DOI: https://doi.org/10.1364/3d.2023.dw5a.3

2023-01-01

Abstract:We propose a visual simulation method for light field 3D display that can accurately simulate the direction modulation of light rays emitted from sub-pixels, achieving a high-accuracy 3D visualization simulation.

What problem does this paper attempt to address?

Light Field 3D Display Based on Projection Technology

Xu Liu,Haifeng Li

DOI: https://doi.org/10.1364/3d.2016.tm3a.2

2016-01-01

Abstract:The principle and different display methods for light field 3D display based on projection technology are presented. Either high-speed projector or projector array is implemented to generate the spatial light field for 3D scenes.
Spatial Three-Dimensional Display Based on the Light-Field Reconstruction

李海峰 li haifeng,刘旭 liu xu

DOI: https://doi.org/10.3788/AOS201131.0900121

2011-01-01

Abstract:The light field distribution of a real object is used to regenerate spatial three-dimensional (3D) display. The principle and techniques are proposed describing how to use light field distribution in the real 3D display. The experimental results show that vivid 3D display with current spatial light modulator can be built up, which can get better 3D effect than the traditional holographic display based on light field regeneration.
A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Xucheng Wang,Wan Liu,Yan Sun,Lin Yang,Zhentao Qin,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2537208

2019-01-01

Abstract:A novel method is proposed in this paper for light field depth estimation by using a convolutional neural network. Many approaches have been proposed to make light field depth estimation, while most of them have a contradiction between accuracy and runtime. In order to solve this problem, we proposed a method which can get more accurate light field depth estimation results with faster speed. First, the light field data is augmented by proposed method considering the light field geometry. Because of the large amount of the light field data, the number of images needs to be reduced appropriately to improve the operation speed, while maintaining the confidence of the estimation. Next, light field images are inputted into our network after data augmentation. The features of the images are extracted during the process, which could be used to calculate the disparity value. Finally, our network can generate an accurate depth map from the input light field image after training. Using this accurate depth map, the 3D structure in real world could be accurately reconstructed. Our method is verified by the HCI 4D Light Field Benchmark and real-world light field images captured with a Lytro light field camera.
Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Wentao Zhang,Shengqian Chang,Xiao Tao,Chang Wang,Chenning Tao,Peizheng Huang,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2319552

2018-01-01

Abstract:A novel method is proposed in this paper to accurately reconstruct the three-dimensional scenes by using a passive single-shot exposure with a lenslet light field camera. This method has better performance of 3D scenes reconstruction with both defocus and disparity depth cues captured by light field camera. First, the light field data is used to refocus and shift viewpoints to get a focal stack and multi-view images. In refocusing procedure, the phase shift theorem in the Fourier domain is first introduced to substitute shift in spatial domain, and sharper focal stacks can be obtained with less blurriness. Thus, 3D scenes can be reconstructed more accurately. Next, through multi-view images, disparity depth cues are obtained by performing correspondence measure. Then, the focal stack is used to compute defocus depth cues by focus measure based on gray variance. Finally, the focus cost is built to integrate both defocus and disparity depth cues, and the accurate depth map is estimated by using Graph Cuts based on the focus cost. Using this accurate depth map and all-in-focus image, the 3D structure in real world are accurately reconstructed. Our method is verified by a number of synthetic and real-world examples captured with a dense camera array and a Lytro light field camera.
Annual Report of “New Methods and Key Elements for Light Field Reconstruction 3D Display”

Haifeng Li,Huan Deng

DOI: https://doi.org/10.3969/j.issn.1674-098X.2016.12.091

2016-01-01

Abstract:This year, we have completed the research for latest international progresses related to the project subjects. Based on the theory of the light field reconstruction true 3D display, two methods of touchable light field 3D display are proposed. First we have verified the principle of the light field reconstruction method based on the light field stitching, and set up a demonstration system. We proposed an automatic geometriccalibrations method based on CCD camera and improved the fineness of splicing and imaging quality. Besides, we set up a high speed color DLP projector using 3 DMD devices. Using this projector, we set up a touchable light field display verification system, which has the view zone of 360 degrees. We analyzed the mechanism of integral imaging light field 3D display, and proposed a moiré-reduced integral imaging display method by tilting the elemental image array based on such mechanism. We also established a theoretical model for integral imaging light field pickup and display, and developed a 3D video-producing software and a 3D video player for integral imaging. We analyzed the mathematical relationships between the parameters of the reconstructed light field and the micro-lens array, as well as the restrictive correlations between them. We also preliminarily developed a liquid micro-lens array device.
A 360-degree floating 3D display based on light field regeneration.

Xinxing Xia,Xu Liu,Haifeng Li,Zhenrong Zheng,Han Wang,Yifan Peng,Weidong Shen

DOI: https://doi.org/10.1364/OE.21.011237

IF: 3.8

2013-01-01

Optics Express

Abstract:Using light field reconstruction technique, we can display a floating 3D scene in the air, which is 360-degree surrounding viewable with correct occlusion effect. A high-frame-rate color projector and flat light field scanning screen are used in the system to create the light field of real 3D scene in the air above the spinning screen. The principle and display performance of this approach are investigated in this paper. The image synthesis method for all the surrounding viewpoints is analyzed, and the 3D spatial resolution and angular resolution of the common display zone are employed to evaluate display performance. The prototype is achieved and the real 3D color animation image has been presented vividly. The experimental results verified the representability of this method. (c) 2013 Optical Society of America
Real 3d Display Based On The Light Field Modulation

Xu Liu,Haifeng Li

2011-01-01

Abstract:How to generate a real 3D image in the space which can be viewed by the many observers around the display with their naked eyes, is the dream of ideal display technique. In this paper, the latest developed real spatial 3D display techniques in Zhejiang University will be presented on the base of light filed controlling technique. These techniques permitted to create 3D scene in the space and with very high density viewing field, so that can be seen as a "holo-view" display. Different light filed controlling techniques: light filed scanning technique and light field integrated technique will be reviewed in the presentation.
32.2: 360‐degree Floating Light Field Three‐dimensional Display Based on a High‐frame‐rate Color Projector

Xinxing Xia,Han Wang,Haifeng Li,Yifan Peng,Zhenrong Zheng,Xu Liu,Weidong Shen

DOI: https://doi.org/10.1002/j.2168-0159.2013.tb06232.x

2013-01-01

SID Symposium Digest of Technical Papers

Abstract:With light field reconstruction technique, displaying a floating 3D image in the air is implemented. The high‐frame‐rate projector and rotating flat light field scanning screen are utilized to create the light field of real 3D scenes. The occlusion‐capable floating 3D image is presented just above the flat diffusing screen.
The Progress of Light‐Field 3‐D Displays

Xu Liu,Haifeng Li

DOI: https://doi.org/10.1002/j.2637-496x.2014.tb00760.x

2014-01-01

Information Display

Abstract:Light‐field displays represent an exciting and promising technology for the future. We introduce the principles of light‐field displays, describe different types of multi‐user light‐field systems, and discuss their relative merits.
72‐2: A High Resolution Near Eye Light Field Display with Fast Reconstruction Speed

Mali Liu,Chihao Lu,Haifeng Li,Xu Liu

DOI: https://doi.org/10.1002/sdtp.11820

2017-01-01

SID Symposium Digest of Technical Papers

Abstract:We proposed an acceleration of reconstructing a high resolution near eye light field display based on human visual features. The reconstructed light field supports high resolution, low‐latency and focus cues. The resolution distribution of the light field is identical to human visual features that visual acuity is different over field of visual.
Research on Monocular Focusing Characteristic for Horizontal Light Field Three-Dimensional Display

Zhou Xinxin,Su Chen,Li Haifeng,Liu Xu

DOI: https://doi.org/10.3788/aos201737.0912001

2017-01-01

Abstract:Horizontal light field three-dimensional (3D) display is an important 3D display method, it can achieve fairly good 3D display effect when remarkably compressing the mass information of light rays that need to be processed. As there is no change in vertical light field, its expressive force of display definition and the ability of monocular focusing for horizontal light field are both different from the ideal light field. The point spread function(PSF) of the horizontal light field is analyzed based on the scanning light field display. Based on the auto-focusing principle of human eye and camera, the horizontal light field that is reconstructed under different display parameters is focusing simulated, which shows that the effect of horizontal scattering angle of light and the image number per screen spinning circle of the projection on the monocular focusing ability in horizontal light field is obtained. The conclusion is verified by using a scanning horizontal light field display prototype. And the results show that the maximum focusing height of horizontal light field declines with the increasing of horizontal diffusing angle of light ray, and it goes up with the increasing of the image number per screen spinning circle of the projection. The proposed analytical method and the conclusion can provide the design consideration for the horizontal light field display system of monocular focusing.
360-degree large-scale multiprojection light-field 3D display system.

Lixia Ni,Zhenxing Li,Haifeng Li,Xu Liu

DOI: https://doi.org/10.1364/AO.57.001817

IF: 1.9

2018-01-01

Applied Optics

Abstract:This paper proposes a 360-deg large-scale multiprojection light-field 3D display system, which can reconstruct the light field of models in real space. The reconstructed contents can be observed by multiple viewers from different angles and positions simultaneously. In this system, 360 projectors project images onto a cylindrical light-field diffusion screen whose height is 1.8 m and diameter is 3 m. When moving around the system, viewers can see 3D scenes with smooth-motion parallax, and the frame rate can reach 30 fps and above. To achieve a large-scale display, we design a wide-field lens with cylindrical lenses to enlarge the projection image. To promote efficiency of data transmission and render 3D contents in real time, we apply computers equipped with multiple graphic cards, and display data are divided by field programmable gate array. Finally, a 360-deg light-field autocalibration method based on CCD and multiview sampling is proposed, whose calibration effect is strongly confirmed by experiment results. (C) 2018 Optical Society of America
24.2: Real‐Time Rendering 360° Floating Light‐Field 3D Display

Chen Su,Qing Zhong,Liang Xu,Haifeng Li,Xu Liu

DOI: https://doi.org/10.1002/sdtp.10248

2015-01-01

SID Symposium Digest of Technical Papers

Abstract:With light field reconstruction technique, real‐time rendering a floating colorful three‐dimensional scene in the air is implemented. The high‐frame‐rate projector, rotating transmitted directional diffuser and high‐speed data processing and transmission module are utilized to create the light field of animated 3D scenes with higher light use efficiency.
Near Eye Light Field Display Based on Human Visual Features.

Mali Liu,Chihao Lu,Haifeng Li,Xu Liu

DOI: https://doi.org/10.1364/oe.25.009886

IF: 3.8

2017-01-01

Optics Express

Abstract:We introduce a near eye light field display proposal to reconstruct a light field in high synthesis speed by utilizing the multi-layer light field display technology and human visual features. The resolution distribution of the reconstructed light field is set to be identical to human visual acuity which decreases with the increasing visual eccentricity. We compress the light field information by using different sampling rates in different visual eccentricity area. A new optimization method for the compressed light field is proposed, which dramatically reduces the amount of calculation. The results demonstrate that the acceleration of the proposed scheme is obvious and escalates when the spatial resolution increases. The synthesis scheme is verified and its key aspects are analyzed by simulation and an experimental prototype.
59.2: Three Dimensional Floating Light‐Field Display Based on Spliced Multi‐LCDs

Yifan Peng,Haifeng Li,Qing Zhong,Xu Liu

DOI: https://doi.org/10.1002/j.2168-0159.2012.tb05905.x

2012-01-01

Abstract:AbstractNovel approach to achieve touchable three dimensional (3D) light field display is investigated. Light field reconstruction principle, multi‐Liquid Crystal Displays (LCDs) spliced style configuration and diffuser characteristic are analyzed, respectively. The point‐to‐point mapping method in image aberration evaluation is proposed which is used not only in the evaluation of 3D imaging performance, but also to construct the distortion compensation for spliced sub‐images on multi‐LCDs. The calibrating method aims to achieve high performance 3D display with considering the system geometrical arrangement and diffuser characteristics. The touchable floating 3D scene displayed by the prototype can be observed with high image resolution and large continuous viewing area.
Towards VR and AR

Chen Su,Yifan Peng,Qing Zhong,Haifeng Li,Rui Wang,Wolfgang Heidrich,Xü Liu

DOI: https://doi.org/10.1145/2988240.2988251

2016-01-01

Abstract:We present a 360° light field display to visualize 3D objects above the table-top screen, and provide a graspable and measurable virtual or augmented reality environment. The display is constructed by a spinning flat-plate deflected diffuser screen, a high-speed light field projector, and the user tracking and interaction components. A rear-projection light propagation is specially designed to reconstruct the light field. By calibrating this levitated light field to the physical dimension, and capturing user gestures, we enable multiple users mid-air interactions based on their virtual measurement perception.
Self‐calibration Three‐dimensional Light Field Display Based on Scalable Multi‐lcds

Yifan Peng,Haifeng Li,Rui Wang,Qing Zhong,Xiang Han,Zisheng Cao,Xu Liu

DOI: https://doi.org/10.1002/jsid.133

2012-01-01

Journal of the Society for Information Display

Abstract:Approach to achieve self-calibration three-dimensional (3D) light field display is investigated in this paper. The proposed 3D light field display is constructed up on spliced multi-LCDs, lens and diaphragm arrays, and directional diffuser. The light field imaging principle, hardware configuration, diffuser characteristic, and image reconstruction simulation are described and analyzed, respectively. Besides the light field imaging, a self-calibration method is proposed to improve the imaging performance. An image sensor is deployed to capture calibration patterns projected onto and then reflected by the polymer dispersed liquid crystal film, which is attached to and shaped the diffuser. These calibration components are assembled with the display unit and can be switched between display mode and calibration mode. In the calibration mode, the imperfect imaging relations of optical components are captured and calibrated automatically. We demonstrate our design by implementing the prototype of proposed 3D light field display by using modified off-the-shelf products. The proposed approach successfully meets the requirement of real application on scalable configuration, fast calibration, large viewing angular range, and smooth motion parallax.
Survey on Light Field 3D Display Applied to Mixed Reality

Chen Su,Haifeng Li

DOI: https://doi.org/10.3969/j.issn.1003-9775.2016.06.005

2016-01-01

Abstract:With the rapid development of computer rendering and display techniques, it is not enough for the en-closed virtual reality device to satisfy the human’s pursuing to the immersive experience, the mixed reality, as an alternative, has been attracted more attention in recent time. Among the solutions of the display techniques aiming at the mixed reality, light field 3D display is able to provide more vivid display performance and more intuitive human-machine interactive experience. We compare several 3D display methods, and discuss the prospects for the light field display applied to the mixed reality by reviewing different light field display prototypes.
Towards VR and AR enhancement: light field display with mid-air interaction.

Chen Su,Yifan Peng,Qing Zhong,Haifeng Li,Rui Wang,Wolfgang Heidrich,Xu Liu

DOI: https://doi.org/10.1145/2992138.2992151

2016-01-01

Abstract:We present a 360° light field display to visualize 3D objects above the table-top screen, and provide a graspable and measurable virtual or augmented reality environment. The display is constructed by a spinning flat-plate deflected diffuser screen, a high-speed light field projector, and the user tracking and interaction components. A rear projection light propagation is specially designed to reconstruct the light field. By calibrating this levitated light field to the physical dimension, and capturing user gestures, we enable multiple users mid-air interactions based on their virtual measurement perception.
Liquid-crystal-display-based touchable light field three-dimensional display using display-capture mapping calibration.

Yifan Peng,Haifeng Li,Qing Zhong,Xu Liu

DOI: https://doi.org/10.1364/AO.51.006014

IF: 1.9

2012-01-01

Applied Optics

Abstract:An approach to achieving a light field three-dimensional (3D) display with a large viewing angular range based on spliced multi-LCDs is investigated. The light field reconstruction principle, LCD-based hardware configuration, and diffuser characteristics are analyzed. A point-to-point mapping calibration method is proposed to improve imaging performance, by using an image sensor to capture the coordinate distributions of the images on the LCD panel, projected onto the display space. By measuring the coordinate distributions, calibration is implemented considering both imaging aberration and geometrical inaccuracy of the whole system. The LCD-based experiment demonstrates that this method can achieve not only fast and precise calibration but also easy scalability, flexible depth, and angular range. A touchable floating 3D scene with correct occlusion, high image resolution, and a large continuous viewing angular range can be observed. (c) 2012 Optical Society of America

A High-Accuracy Visual Simulation Method for Light Field 3D Display

Light Field 3D Display Based on Projection Technology

Spatial Three-Dimensional Display Based on the Light-Field Reconstruction

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Annual Report of “New Methods and Key Elements for Light Field Reconstruction 3D Display”

A 360-degree floating 3D display based on light field regeneration.

Real 3d Display Based On The Light Field Modulation

32.2: 360‐degree Floating Light Field Three‐dimensional Display Based on a High‐frame‐rate Color Projector

The Progress of Light‐Field 3‐D Displays

72‐2: A High Resolution Near Eye Light Field Display with Fast Reconstruction Speed

Research on Monocular Focusing Characteristic for Horizontal Light Field Three-Dimensional Display

360-degree large-scale multiprojection light-field 3D display system.

24.2: Real‐Time Rendering 360° Floating Light‐Field 3D Display

Near Eye Light Field Display Based on Human Visual Features.

59.2: Three Dimensional Floating Light‐Field Display Based on Spliced Multi‐LCDs

Towards VR and AR

Self‐calibration Three‐dimensional Light Field Display Based on Scalable Multi‐lcds

Survey on Light Field 3D Display Applied to Mixed Reality

Towards VR and AR enhancement: light field display with mid-air interaction.

Liquid-crystal-display-based touchable light field three-dimensional display using display-capture mapping calibration.