Abstract:We present a machine learning approach for efficiently computing order independent transparency (OIT). Our method is fast, requires a small constant amount of memory (depends only on the screen resolution and not on the number of triangles or transparent layers), is more accurate as compared to previous approximate methods, works for every scene without setup and is portable to all platforms running even with commodity GPUs. Our method requires a rendering pass to extract all features that are subsequently used to predict the overall OIT pixel color with a pre-trained neural network. We provide a comparative experimental evaluation and shader source code of all methods for reproduction of the experiments.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve a key problem in computer graphics: **efficient computation of Order Independent Transparency (OIT)**. Specifically, the author proposes a deep - learning - based method to approximately calculate OIT in order to achieve real - time performance and high - quality transparent effects. #### Background problems: 1. **Rendering challenges of transparent objects**: - In a scene, transparent objects (such as glass, water, smoke, etc.) often overlap each other, resulting in incorrect rendering output. - Traditional transparency processing methods rely on the order of geometries, which is difficult to achieve and error - prone in real - time applications. 2. **Limitations of existing OIT methods**: - **Average OIT method**: It is fast but has poor accuracy. - **Hybrid OIT method**: It is fast and has relatively good accuracy, but each fragment requires additional processing overhead. - **Multi - fragment OIT method**: It has the best quality but sacrifices performance and memory. - **Hybrid OIT method**: It combines multi - fragment and average/hybrid methods, but is still not efficient or accurate enough in some cases. #### The method proposed in the paper: - **Deep and Fast Approximate OIT (DFAOIT)**: Use a deep - learning model to predict the final transparent color of each pixel. - **Input features**: Include global per - pixel measurements, such as average color and transparency. - **Neural network inference**: Runs efficiently in the fragment shader without the need for high - end graphics hardware support. #### Main contributions: 1. **First use of deep learning**: Utilize a deep - learning model to approximately calculate OIT based on global per - pixel measurements. 2. **Higher accuracy**: Compared with the existing average or hybrid OIT methods, DFAOIT provides 20% - 80% better accuracy (using mean - squared error as a metric). 3. **Cross - platform implementation**: OIT rendering can be implemented on any device without relying on specific hardware. 4. **No need for user parameter adjustment**: Users do not need to determine or adjust any parameters before rendering. 5. **Improve the hybrid OIT method**: It can be used to improve the tail part of the hybrid OIT method and improve the overall effect. Through this method, the paper solves the trade - off problem between real - time performance and accuracy in existing OIT methods and provides a more efficient and accurate solution.

Deep and Fast Approximate Order Independent Transparency

Deep and Fast Approximate Order Independent Transparency

Large Image Fast Compositing Based on Uniform Sample

GPU accelerated rendering smooth silhouettes

An approximate image-space approach for real-time rendering of deformable translucent objects

Fast, Realistic Lighting and Material Design Using Nonlinear Cut Approximation

LucidRaster: GPU Software Rasterizer for Exact Order-Independent Transparency

Dynamic Anisotropic Occlusion

Fast Differentiable Transient Rendering for Non-Line-of-Sight Reconstruction

Deep Illumination: Approximating Dynamic Global Illumination with Generative Adversarial Network

Real-Time Rendering of Heterogeneous Translucent Objects with Arbitrary Shapes

LIT: Light-field Inference of Transparency for Refractive Object Localization

Trustworthy Self-Attention: Enabling the Network to Focus Only on the Most Relevant References

Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior

Lightweight Bilateral Convolutional Neural Networks for Interactive Single-Bounce Diffuse Indirect Illumination.

Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

Multi-layer depth peeling via fragment sort

Neural Scene Baking for Permutation Invariant Transparency Rendering with Real-time Global Illumination

IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination

Diffusion-Based Depth Inpainting for Transparent and Reflective Objects

FDCT: Fast Depth Completion for Transparent Objects