An efficient GPU-based approach for interactive global illumination

WangRui,ZhouKun,PanMinghao,BaoHujun

IF: 6.2

2009-01-01

ACM Transactions on Graphics

Abstract:This paper presents a GPU-based method for interactive global illumination that integrates complex effects such as multi-bounce indirect lighting, glossy reflections, caustics, and arbitrary specul...

What problem does this paper attempt to address?

An Efficient GPU-based Approach for Interactive Global Illumination

Rui Wang,Kun Zhou,Minghao Pan,Hujun Bao

DOI: https://doi.org/10.1145/1576246.1531397

2009-01-01

Abstract:This paper presents a GPU-based method for interactive global illumination that integrates complex effects such as multi-bounce indirect lighting, glossy reflections, caustics, and arbitrary specular paths. Our method builds upon scattered data sampling and interpolation on the GPU. We start with raytraced shading points and partition them into coherent shading clusters using adaptive seeding followed by k-means. At each cluster center we apply final gather to evaluate its incident irradiance using GPU-based photon mapping. We approximate the entire photon tree as a compact illumination cut, thus reducing the final gather cost for each ray. The sampled irradiance values are then interpolated at all shading points to produce rendering. Our method exploits the spatial coherence of illumination to reduce sampling cost. We sample sparsely and the distribution of sample points conforms with the underlying illumination changes. Therefore our method is both fast and preserves high rendering quality. Although the same property has been exploited by previous caching and adaptive sampling methods, these methods typically require sequential computation of sample points, making them ill-suited for the GPU. In contrast, we select sample points adaptively in a single pass, enabling parallel computation. As a result, our algorithm runs entirely on the GPU, achieving interactive rates for scenes with complex illumination effects.
Fast Global Illumination Rendering with Reflection, Refraction and Caustic Effects

Ruirui Li,Kaihuai Qin,Yitian Zhang

DOI: https://doi.org/10.3969/j.issn.1003-9775.2013.08.004

2013-01-01

Abstract:This paper presents a global illumination rendering method that renders direct and indirect lighting, reflection, refraction and caustic effects simultaneously and fast. In this method, coarse voxels are used to compute low-frequency indirect lighting while fine images are used to simulate high-frequency reflection, refraction and caustic effects. Combining the sampling of the coarse voxels and the fine images, three techniques, including the generation of a deferred gathering buffer for reflective/refractive samples, a voxel-based bidirectional illumination and an adaptive multi-resolution gathering, are introduced in rendering. Compared with photon mapping and other GPU-accelerated rendering algorithms, the method in this paper simulates multiple effects with high image quality faster. For fully dynamic scenes, the rendering speed is between 10 and 30 frames per second.
Interactive Approximate Rendering of Reflections, Refractions, and Caustics.

Wei Hu,Kaihuai Qin

DOI: https://doi.org/10.1109/tvcg.2007.14

IF: 5.2

2007-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:Reflections, refractions, and caustics are very important for rendering global illumination images. Although many methods can be applied to generate these effects, the rendering performance is not satisfactory for interactive applications. In this paper, complex ray-object intersections are simplified so that the intersections can be computed on a GPU, and an iterative computing scheme based on the depth buffers is used for correcting the approximate results caused by the simplification. As a result, reflections and refractions of environment maps and nearby geometry can be rendered on a GPU interactively without preprocessing. We can even achieve interactive recursive reflections and refractions by using an object-impostor technique. Moreover, caustic effects caused by reflections and refractions can be rendered by placing the eye at the light. Rendered results prove that our method is sufficiently efficient to render plausible images interactively for many interactive applications.
Interactive global illumination in walking-through environment

Xiaoyang Xu,Juo Jie,Jingui Pan

2010-01-01

Journal of Information and Computational Science

Abstract:This paper proposes an approach to interactive global illumination in a walking-through environment, in which a virtual avatar moves around while other models stay static. Global lighting effects are composed of direct lighting from area light sources and indirect lighting simulated by massive virtual point lights, which are updated adaptively every frame to response avatar's movement. Realistic shadow effects are generated in real time by integrating both shadow map and kd-tree technologies. To exploit high-performance computing capability of current graphics hardware, we deploy our rendering algorithm onto a hybrid CPU-GPU infrastructure. Frame data is first prepared on CPU side and illuminated totally on a GPU cluster. Using asynchronous data update strategy, high resolution images with plausible global lighting effects are generated at nearly real-time frame rates. Copyright © 2010 Binary Information Press.
Spherical Gaussian-based Lightcuts for Glossy Interreflections.

Y. C. Huo,S. H. Jin,T. Liu,W. Hua,R. Wang,H. J. Bao

DOI: https://doi.org/10.1111/cgf.14011

IF: 2.5

2020-01-01

Computer Graphics Forum

Abstract:It is still challenging to render directional but non-specular reflections in complex scenes. The SG-based (Spherical Gaussian) many-light framework provides a scalable solution but still requires a large number of glossy virtual lights to avoid spikes as well as reduce clamping errors. Directly gathering contributions from these glossy virtual lights to each pixel in a pairwise way is very inefficient. In this paper, we propose an adaptive algorithm with tighter error bounds to efficiently compute glossy interreflections from glossy virtual lights. This approach is an extension of the Lightcuts that builds hierarchies on both lights and pixels with new error bounds and new GPU-based traversal methods between light and pixel hierarchies. Results demonstrate that our method is able to faithfully and efficiently compute glossy interreflections in scenes with highly glossy and spatial varying reflectance. Compared with the conventional Lightcuts method, our approach generates lightcuts with only one-fourth to one-fifth light nodes therefore exhibits better scalability. Additionally, after being implemented on GPU, our algorithms achieve a magnitude of faster performance than the previous method.
Global optimization based image inpainting andits implementation on GPU

Jianming Liu,Dongming Lu,Rong Ge

DOI: https://doi.org/10.3785/j.issn.1008-973X.2011.02.009

2011-01-01

Abstract:Since greedy image inpainting algorithms might cause visual inconsistency, and global optimization based inpainting algorithms didn't consider structure information, a new fast image inpainting algorithm based on global optimization is proposed. The image inpainting was formulated as a global optimization problem by defining an improved energy function, and a non-local mean based label pruning algorithm was adopted to cut down the number of labels for each node so as to reduce the complexity of the optimization algorithm significantly. Graphic processing unit (GPU) was used to further improve the computing speed. Compared with greedy synthesis and global optimization based image inpainting methods, the proposed approach not only avoids the inter-block discontinuity but also achieves better efficiency.
Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Jiakai Sun,Zhanjie Zhang,Tianyi Chu,Guangyuan Li,Lei Zhao,Wei Xing

DOI: https://doi.org/10.48550/arxiv.2305.16800

2023-01-01

Abstract: Traditional inverse rendering techniques are based on textured meshes, which naturally adapts to modern graphics pipelines, but costly differentiable multi-bounce Monte Carlo (MC) ray tracing poses challenges for modeling global illumination. Recently, neural fields has demonstrated impressive reconstruction quality but falls short in modeling indirect illumination. In this paper, we introduce a simple yet efficient inverse rendering framework that combines the strengths of both methods. Specifically, given pre-trained neural field representing the scene, we can obtain an initial estimate of the signed distance field (SDF) and create a Neural Radiance Cache (NRC), an enhancement over the traditional radiance cache used in real-time rendering. By using the former to initialize differentiable marching tetrahedrons (DMTet) and the latter to model indirect illumination, we can compute the global illumination via single-bounce differentiable MC ray tracing and jointly optimize the geometry, material, and light through back propagation. Experiments demonstrate that, compared to previous methods, our approach effectively prevents indirect illumination effects from being baked into materials, thus obtaining the high-quality reconstruction of triangle mesh, Physically-Based (PBR) materials, and High Dynamic Range (HDR) light probe.
Neural Global Illumination Via Superposed Deformable Feature Fields

Chuankun Zheng,Yuchi Huo,Hongxiang Huang,Hongtao Sheng,Junrong Huang,Rui Tang,Hao Zhu,Rui Wang,Hujun Bao

DOI: https://doi.org/10.1145/3680528.3687680

2024-01-01

Abstract:Interactive rendering of dynamic scenes with complex global illumination has been a long-standing problem in computer graphics. Recent advances in neural rendering demonstrate new promising possibilities. However, while existing methods have achieved impressive results, complex rendering effects (e.g., caustics) remain challenging. This paper presents a novel neural rendering method that is able to generate high-quality global illumination effects, including but not limited to caustics, soft shadows, and indirect highlights, for dynamic scenes with varying camera, lighting conditions, materials, and object transformations. Inspired by object-oriented transfer field representations, we employ deformable neural feature fields to implicitly model the impacts of individual objects or light sources on global illumination. By employing neural feature fields, our method gains the ability to represent high-frequency details, thus supporting complex rendering effects. We superpose these feature fields in latent space and utilize a lightweight decoder to obtain global illumination estimates, which allows our neural representations to spontaneously adapt to the contribution of individual objects or light sources to global illumination in a data-driven manner, thus further improving the quality. Our experiments demonstrate the effectiveness of our method on a wide range of scenes with complex light paths, materials, and geometries.
GI-1.0: A Fast and Scalable Two-level Radiance Caching Scheme for Real-time Global Illumination

Guillaume Boissé,Sylvain Meunier,Heloise de Dinechin,Pieterjan Bartels,Alexander Veselov,Kenta Eto,Takahiro Harada

2023-10-31

Abstract:Real-time global illumination is key to enabling more dynamic and physically realistic worlds in performance-critical applications such as games or any other applications with real-time constraints.Hardware-accelerated ray tracing in modern GPUs allows arbitrary intersection queries against the geometry, making it possible to evaluate indirect lighting entirely at runtime. However, only a small number of rays can be traced at each pixel to maintain high framerates at ever-increasing image resolutions. Existing solutions, such as probe-based techniques, approximate the irradiance signal at the cost of a few rays per frame but suffer from a lack of details and slow response times to changes in lighting. On the other hand, reservoir-based resampling techniques capture much more details but typically suffer from poorer performance and increased amounts of noise, making them impractical for the current generation of hardware and gaming consoles. To find a balance that achieves high lighting fidelity while maintaining a low runtime cost, we propose a solution that dynamically estimates global illumination without needing any content preprocessing, thus enabling easy integration into existing real-time rendering pipelines.

Graphics
Dynamic Voxel‐Based Global Illumination

Alejandro Cosin Ayerbe,Pierre Poulin,Gustavo Patow

DOI: https://doi.org/10.1111/cgf.15262

IF: 2.5

2024-10-04

Computer Graphics Forum

Abstract:We propose a real‐time voxel‐based global illumination solution for a single light bounce that handles static and dynamic objects with diffuse materials under a dynamic light source. Our divide‐and‐win approach, which ray traces separately static and dynamic objects, reduces the re‐computation load with updates of any number of dynamic objects. Global illumination computation in real time has been an objective for Computer Graphics since its inception. Unfortunately, its implementation has challenged up to now the most advanced hardware and software solutions. We propose a real‐time voxel‐based global illumination solution for a single light bounce that handles static and dynamic objects with diffuse materials under a dynamic light source. The combination of ray tracing and voxelization on the GPU offers scalability and performance. Our divide‐and‐win approach, which ray traces separately static and dynamic objects, reduces the re‐computation load with updates of any number of dynamic objects. Our results demonstrate the effectiveness of our approach, allowing the real‐time display of global illumination effects, including colour bleeding and indirect shadows, for complex scenes containing millions of polygons.

computer science, software engineering
Efficient Point Based Global Illumination on GPU.

Beibei Wang,Zhen Xu,Yanning Xu,Xiangxu Meng

DOI: https://doi.org/10.2312/conf/eg2012/posters/017-018

2012-01-01

Abstract:Point based rendering can simulate global illumination phenomenon fast and is widely used in movie production. This paper proposes a point based color bleeding algorithm based on GPU efficiently. In our algorithm, we reorder the shading points according to the similarity of them to use the coherency of the GPU memory. Then, we propose a novel idea named chunking to accelerate the point cloud traversal process by using the constant memory of GPU.
Intersection fields for interactive global illumination

Zhong Ren,Wei Hua,Lu Chen,Hujun Bao

DOI: https://doi.org/10.1007/s00371-005-0329-8

IF: 2.835

2005-01-01

The Visual Computer

Abstract:We present a novel visibility representation, Intersection Field ( i -Field), to compute global illumination in interactive rates. The i -Field provides fast visibility and line-scene intersection queries. We factorize the direct illumination into local irradiance and visibility ratio. The latter is efficiently evaluated by querying the i -Field. The indirect illumination is simulated by photon tracing, which is also accelerated by the i -Field. By quickly detecting invalid portions, our approach can handle highly dynamic scenes, allowing light sources and scene geometries to be manipulated at interactive rates through rigid transformations and free deformations.
Efficient Light Probes for Real-Time Global Illumination.

Jie Guo,Zijing Zong,Yadong Song,Xihao Fu,Chengzhi Tao,Yanwen Guo,Ling-Qi Yan

DOI: https://doi.org/10.1145/3550454.3555452

IF: 6.2

2022-01-01

ACM Transactions on Graphics

Abstract:Reproducing physically-based global illumination (GI) effects has been a long-standing demand for many real-time graphical applications. In pursuit of this goal, many recent engines resort to some form of light probes baked in a precomputation stage. Unfortunately, the GI effects stemming from the precomputed probes are rather limited due to the constraints in the probe storage, representation or query. In this paper, we propose a new method for probe-based GI rendering which can generate a wide range of GI effects, including glossy reflection with multiple bounces, in complex scenes. The key contributions behind our work include a gradient-based search algorithm and a neural image reconstruction method. The search algorithm is designed to reproject the probes' contents to any query viewpoint, without introducing parallax errors, and converges fast to the optimal solution. The neural image reconstruction method, based on a dedicated neural network and several G-buffers, tries to recover high-quality images from low-quality inputs due to limited resolution or (potential) low sampling rate of the probes. This neural method makes the generation of light probes efficient. Moreover, a temporal reprojection strategy and a temporal loss are employed to improve temporal stability for animation sequences. The whole pipeline runs in realtime (>30 frames per second) even for high-resolution (1920×1080) outputs, thanks to the fast convergence rate of the gradient-based search algorithm and a light-weight design of the neural network. Extensive experiments on multiple complex scenes have been conducted to show the superiority of our method over the state-of-the-arts.
Real-time All-Frequency Global Illumination with Radiance Caching

Youxin Xing,Gaole Pan,Xiang Chen,Ji Wu,Lu Wang,Beibei Wang

DOI: https://doi.org/10.1007/s41095-023-0367-z

2024-01-01

Abstract:Global illumination (GI) plays a crucial role in rendering realistic results for virtual exhibitions, such as virtual car exhibitions. These scenarios usually include all-frequency bidirectional reflectance distribution functions (BRDFs), although their geometries and light configurations may be static. Rendering all-frequency BRDFs in real time remains challenging due to the complex light transport. Existing approaches, including precomputed radiance transfer, light probes, and the most recent path-tracing-based approaches (ReSTIR PT), cannot satisfy both quality and performance requirements simultaneously. Herein, we propose a practical hybrid global illumination approach that combines ray tracing and cached GI by caching the incoming radiance with wavelets. Our approach can produce results close to those of offline renderers at the cost of only approximately 17 ms at runtime and is robust over all-frequency BRDFs. Our approach is designed for applications involving static lighting and geometries, such as virtual exhibitions.
Fast Multi-Image-based Photon Tracing with Grid-Based Gathering.

Yun Fei,Bin Wang

DOI: https://doi.org/10.1145/2342896.2343018

2012-01-01

Abstract:We developed a real-time solution for approximate global illumination, where the temporal cost in complex scenes is dramatically reduced. Our approach initially traces photon-rays with multiple cube-maps, and then gathers the irradiance of photons using uniform grids filled with low-order spherical harmonics. Numerous global illumination effects can be rendered efficiently in our framework.
Efficient Point Based Global Illumination on Intel MIC Architecture

Xiang Xu,Pei Wang,Beibei Wang,Lu Wang,Changhe Tu,Xiangxu Meng,Tamy Boubekeur

DOI: https://doi.org/10.2312/egp.20161040

2016-01-01

Abstract:Point-Based Global Illumination (PBGI) is a popular rendering method in special effects and motion picture productions. The tree-cut computation is in general the most time consuming part of this algorithm, but it can be formulated for efficient parallel execution, in particular regarding wide-SIMD hardware. In this context, we propose several vectorization schemes, namely single, packet and hybrid, to maximize the utilization of modern CPU architectures. While for the single scheme, 16 nodes from the hierarchy are processed for a single receiver in parallel, the packet scheme handles one node for 16 receivers. These two schemes work well for scenes having smooth geometry and diffuse material. When the scene contains high frequency bumps maps and glossy reflections, we use a hybrid vectorization method. We conduct experiments on an Intel Many Integrated Core architecture and report preliminary results on several scenes, showing that up to a 3x speedup can be achieved when compared with non-vectorized execution.
Parallel and Adaptive Visibility Sampling for Rendering Dynamic Scenes with Spatially Varying Reflectance.

Rui Wang,Minghao Pan,Xiang Han,Weifeng Chen,Hujun Bao

DOI: https://doi.org/10.1016/j.cag.2013.10.036

IF: 1.821

2013-01-01

Computers & Graphics

Abstract:Fast rendering of dynamic scenes with natural illumination, all-frequency shadows and spatially varying reflections is important but challenging. One main difficulty brought by moving objects is that the runtime visibility update of dynamic occlusion is usually time-consuming and slow. In this paper, we present a new visibility sampling technique and show that efficient all-frequency rendering of dynamic scenes can be achieved by sampling visibility of dynamic objects in an adaptive and parallel way. First, we propose a two-level adaptive sampling scheme to distribute sample points spatially and compute visibility maps angularly on each sample point. Then, we present a parallel hemispherical distance transform to convert these visibility maps into spherical signed distance fields. Finally, using such a distance-based visibility representation, we integrate our visibility sampling algorithm in the all-frequency rendering framework for scenes with spatially varying BRDFs. With an entire GPU-based implementation, our algorithm enables interactive all-frequency rendering of moderate dynamic scenes with environment lighting and spatially varying reflectance.
Neural Global Illumination: Interactive Indirect Illumination Prediction Under Dynamic Area Lights

Duan Gao,Haoyuan Mu,Kun Xu

DOI: https://doi.org/10.1109/TVCG.2022.3209963

Abstract:We propose neural global illumination, a novel method for fast rendering full global illumination in static scenes with dynamic viewpoint and area lighting. The key idea of our method is to utilize a deep rendering network to model the complex mapping from each shading point to global illumination. To efficiently learn the mapping, we propose a neural-network-friendly input representation including attributes of each shading point, viewpoint information, and a combinational lighting representation that enables high-quality fitting with a compact neural network. To synthesize high-frequency global illumination effects, we transform the low-dimension input to higher-dimension space by positional encoding and model the rendering network as a deep fully-connected network. Besides, we feed a screen-space neural buffer to our rendering network to share global information between objects in the screen-space to each shading point. We have demonstrated our neural global illumination method in rendering a wide variety of scenes exhibiting complex and all-frequency global illumination effects such as multiple-bounce glossy interreflection, color bleeding, and caustics.
Factorized Point Based Global Illumination

Beibei Wang,Jing Huang,Bert Buchholz,Xiangxu Meng,Tamy Boubekeur

DOI: https://doi.org/10.1111/cgf.12157

IF: 2.5

2013-01-01

Computer Graphics Forum

Abstract:The Point-Based Global Illumination (PBGI) algorithm is composed of two major steps: a caching step and a multiview rasterization step. At caching time, a dense point-sampling of the scene is shaded and organized in a spatial hierarchy, with internal nodes approximating the radiance of their subtrees using spherical harmonics. At rasterization time, a microbuffer is instantiated at the unprojected position of each image pixel (receiver). Then, a view-adaptive level-of-detail of the scene is extracted in the form of a tree cut and rasterized in the receiver's microbuffer, solving for visibility using a local variant of the z-buffer. Finally, the pixel color is computed by convolving its filled microbuffer with the surface BRDF. This noise-free indirect lighting method is widely used in the industry and captures several critical lighting effects, including ambient occlusion, color bleeding, (indirect) soft-shadows and environment lighting. However, we observe a large redundancy in this algorithm, both in cuts and receivers'microbuffers, which stems from their relatively low resolution. In this paper, we propose an evolution of PBGI which exploits spatial coherence to reduce these redundant computations. Starting from a similarity-based variational clustering of the receivers, we compute a single tree cut and rasterize a single microbuffer for each cluster. This per-cluster microbuffer provides a faithful approximation of the incident radiance for distant nodes and is composited over a receiver-specific microbuffer rasterizing only the closest nodes of the cluster's cut. This factorized approach is easy to integrate in any existing PBGI implementation and offers a significant rendering speed-up for a negligible and controllable approximation error.
GPU Parallel Acceleration of Beam Tracing for Propagation Prediction in Urban Environments

Xiangyang He,Chunbei Luo,Hai Lin

DOI: https://doi.org/10.1109/compem.2018.8496672

2018-01-01

Abstract:This paper proposes a superior GPU-accelerated beam tracing method for urban environment propagation prediction including direct, reflection and transmission. We exploit the method converting the data structure of beam tracing algorithm based on localized KD-Tree to GPU memory and uploading computationally complex process to parallel implementations. Local coordinate strategy and a small amount of double precision arithmetic is utilized to remain the accuracy of double as much as possible. In the proposed method, the error of effective paths is computed by CPU and GPU respectively to present high accuracy, and the average time in several time-consuming parts with and without GPU are listed to demonstrate corresponding efficiency.

An efficient GPU-based approach for interactive global illumination

An Efficient GPU-based Approach for Interactive Global Illumination

Fast Global Illumination Rendering with Reflection, Refraction and Caustic Effects

Interactive Approximate Rendering of Reflections, Refractions, and Caustics.

Interactive global illumination in walking-through environment

Spherical Gaussian-based Lightcuts for Glossy Interreflections.

Global optimization based image inpainting andits implementation on GPU

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Neural Global Illumination Via Superposed Deformable Feature Fields

GI-1.0: A Fast and Scalable Two-level Radiance Caching Scheme for Real-time Global Illumination

Dynamic Voxel‐Based Global Illumination

Efficient Point Based Global Illumination on GPU.

Intersection fields for interactive global illumination

Efficient Light Probes for Real-Time Global Illumination.

Real-time All-Frequency Global Illumination with Radiance Caching

Fast Multi-Image-based Photon Tracing with Grid-Based Gathering.

Efficient Point Based Global Illumination on Intel MIC Architecture

Parallel and Adaptive Visibility Sampling for Rendering Dynamic Scenes with Spatially Varying Reflectance.

Neural Global Illumination: Interactive Indirect Illumination Prediction Under Dynamic Area Lights

Factorized Point Based Global Illumination

GPU Parallel Acceleration of Beam Tracing for Propagation Prediction in Urban Environments