Abstract:Autostereoscopic display, despite decades of development, has not achieved extensive application, primarily due to the daunting challenge of 3D content creation for non-specialists. The emergence of Radiance Field as an innovative 3D representation has markedly revolutionized the domains of 3D reconstruction and generation. This technology greatly simplifies 3D content creation for common users, broadening the applicability of Light Field Displays (LFDs). However, the combination of these two fields remains largely unexplored. The standard paradigm to create optimal content for parallax-based light field displays demands rendering at least 45 slightly shifted views preferably at high resolution per frame, a substantial hurdle for real-time rendering. We introduce DirectL, a novel rendering paradigm for Radiance Fields on 3D displays. We thoroughly analyze the interweaved mapping of spatial rays to screen subpixels, precisely determine the light rays entering the human eye, and propose subpixel repurposing to significantly reduce the pixel count required for rendering. Tailored for the two predominant radiance fields--Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS), we propose corresponding optimized rendering pipelines that directly render the light field images instead of multi-view images. Extensive experiments across various displays and user study demonstrate that DirectL accelerates rendering by up to 40 times compared to the standard paradigm without sacrificing visual quality. Its rendering process-only modification allows seamless integration into subsequent radiance field tasks. Finally, we integrate DirectL into diverse applications, showcasing the stunning visual experiences and the synergy between LFDs and Radiance Fields, which unveils tremendous potential for commercialization applications. \href{<a class="link-external link-http" href="http://direct-l.github.io" rel="external noopener nofollow">this http URL</a>}{\textbf{Project Homepage}

Real-time hierarchical parallel rendering and display of light field images

Real-time Representation and Rendering of High Resolution 3D Light Field Based on Texture Enhanced Optical Flow Prediction

24.2: Real‐Time Rendering 360° Floating Light‐Field 3D Display

Parallel Multi-View Polygon Rasterization for 3D Light Field Display

Real-time Optical Reconstruction for a Three-Dimensional Light-Field Display Based on Path-Tracing and CNN Super-Resolution.

360-degree large-scale multiprojection light-field 3D display system.

32.2: 360‐degree Floating Light Field Three‐dimensional Display Based on a High‐frame‐rate Color Projector

Real-time Light-Field Generation Based on the Visual Hull for the 3D Light-Field Display with Free-Viewpoint Texture Mapping

Toward Low-Computation Light Field Displays by Foveated Rendering

Parallel Volume Rendering Based on LOD Method

Light Field Video Compression and Real Time Rendering

A 3dof+View Rendering Method For Panoramic Light Field

Real-time 3D Acquisition Method for Light Field 3D Display

360 Deg Full-Parallax Light-Field Display Using Panoramic Camera

72‐2: A High Resolution Near Eye Light Field Display with Fast Reconstruction Speed

Medical Volume Data Real-Time Optical Reconstruction on Light Field Display with a Directional Diffuser

Light Field Rendering of Dynamic Scene

DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays

Real-time Super High Resolution Light Field Rendering with Multi-GPU Scheduling

Light Field 3D Display Based on Projection Technology

Parallel Light Fields: A Perspective and A Framework