Abstract:Real-time dense view synthesis based on three-dimensional (3D) reconstruction of real scenes is still a challenge for 3D light-field display. It’s time-consuming to reconstruct an entire model, and then the target views are synthesized afterward based on volume rendering. To address this issue, Light-field Visual Hull (LVH) is presented with free-viewpoint texture mapping for 3D light-field display, which can directly produce synthetic images with the 3D reconstruction of real scenes in real-time based on forty free-viewpoint RGB cameras. An end-to-end subpixel calculation procedure of the synthetic image is demonstrated, which defines a rendering ray for each subpixel based on light-field image coding. In the ray propagation process, only the essential spatial point of the target model is located for the corresponding subpixel by projecting the frontmost point of the ray to all the free-viewpoints, and the color of each subpixel is identified in one pass. A dynamic free-viewpoint texture mapping method is proposed to solve the correct graphic texture considering the free-viewpoint cameras. To improve the efficiency, only the visible 3D position and texture that contributes to the synthetic image are calculated based on backward ray tracing rather than computing the entire 3D model and generating all elemental images. In addition, an incremental calibration method by dividing camera groups is proposed to satisfy the accuracy. Experimental results show the validity of our method. All the rendered views are analyzed for justifying the texture mapping method, and the PSNR is improved by an average of 11.88dB. Finally, LVH can achieve a natural and smooth viewing effect at 4K resolution and the frame rate of 25 ∼ 30fps with a large viewing angle.

Near Eye Light Field Display Based on Human Visual Features.

72‐2: A High Resolution Near Eye Light Field Display with Fast Reconstruction Speed

Optimization algorithm of near-eye light field displays based on human visual characteristics

Apparent Resolution Enhancement for Near-Eye Light Field Display

P-66: Near-eye Light Field Displays Optimization Based on Sub-pixel Structure of LCD

Toward Low-Computation Light Field Displays by Foveated Rendering

Foveated Light-Field Display and Real-Time Rendering for Virtual Reality

A 360-degree floating 3D display based on light field regeneration.

10‐2: A Deep Depth of Field Near Eye Light Field Displays Utilizing LC Lens and Dual‐layer LCDs

Optimized Image Synthesis for Multi-Projector-Type Light Field Display

15.4: Weight Optimization of Near‐Eye Light Field Displays Based on Human Visual System

Hybrid Computational Near-Eye Light Field Display

Bifocal computational near eye light field displays and Structure parameters determination scheme for bifocal computational display.

360-degree large-scale multiprojection light-field 3D display system.

Real-time Light-Field Generation Based on the Visual Hull for the 3D Light-Field Display with Free-Viewpoint Texture Mapping

32.2: 360‐degree Floating Light Field Three‐dimensional Display Based on a High‐frame‐rate Color Projector

Epipolar Focus Spectrum: A Novel Light Field Representation and Application in Dense-view Reconstruction

High-Resolution 3d Model Reconstruction For Light Field Display

Light Field Display: an Adaptive Weighted Dual-Layer LCD Display for Multiple Views

A Crosstalk-Suppressed Dense Multi-View Light-Field Display Based on Real-Time Light-Field Pickup and Reconstruction

Real-time Representation and Rendering of High Resolution 3D Light Field Based on Texture Enhanced Optical Flow Prediction