Abstract:Many lighting methods used in computer graphics such as indirect illumination can have very high computational costs and need to be approximated for real-time applications. These costs can be reduced by means of upsampling techniques which tend to introduce artifacts and affect the visual quality of the rendered image. This paper suggests a versatile approach for accelerating the rendering of screen space methods while maintaining the visual quality. This is achieved by exploiting the low frequency nature of many of these illumination methods and the geometrical continuity of the scene. First the screen space is dynamically divided into separate sub-images, then the illumination is rendered for each sub-image in an adequate resolution and finally the sub-images are put together in order to compose the final image. Therefore we identify edges in the scene and generate masks precisely specifying which part of the image is included in which sub-image. The masks therefore determine which part of the image is rendered in which resolution. A step wise upsampling and merging process then allows optically soft transitions between the different resolution levels. For this paper, the introduced multi-resolution rendering method was implemented and tested on three commonly used lighting methods. These are screen space ambient occlusion, soft shadow mapping and screen space global illumination.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in computer graphics, many lighting methods (such as indirect lighting) have a very high computational cost and are difficult to implement in real - time applications. To reduce these costs, up - sampling techniques are usually used, but this will lead to image artifacts and affect the visual quality of the rendered image.
Specifically, the paper proposes a multi - resolution rendering method, aiming to accelerate the rendering of screen - space methods while maintaining visual quality. By taking advantage of the low - frequency characteristics of many lighting methods and the geometric continuity of the scene, this method first dynamically divides the screen space into multiple sub - images, then renders the lighting effects of each sub - image at an appropriate resolution, and finally combines the sub - images to generate the final image. This method can effectively reduce the amount of calculation and has almost no difference visually from the image rendered at full resolution.
### Key points of the problem solved by the paper
1. **Multi - resolution division**: According to the edge information in the scene, the image is divided into multiple sub - images, and each sub - image is rendered at a different resolution according to its content.
2. **Edge detection and mask generation**: Identify the edges in the scene and generate masks to determine which parts need high - resolution rendering and which parts can be rendered at low resolution.
3. **Gradual up - sampling and merging**: Through gradual up - sampling and merging of sub - images of different resolutions, an optically smooth transition is achieved and artifacts are avoided.
4. **Flexible application**: This method is not only applicable to indirect lighting, but can also be applied to other lighting effects, such as screen - space ambient occlusion (SSAO), soft shadow mapping (SSM) and screen - space global illumination (SSGI).
### Formula representation
In the paper, the author uses the following formula to describe the process of sub - image fusion:
\[ c'_i = c_i \cdot \min(a_i w_i, 1) + c'_{i - 1} \cdot (1 - \min(a_i w_i, 1)) \]
where:
- \( c_i \) is the color value of the pixel in the \( i \) - th sub - image.
- \( c'_i \) is the composite image containing the \( i \) - th sub - image as the highest resolution.
- \( a_i \) is the alpha value from the corresponding mask.
- \( w_i \) is the weight.
Through this formula, sub - images of different resolutions are fused layer by layer, and finally a high - quality rendering result is generated.
### Summary
The multi - resolution rendering method proposed in the paper effectively solves the problem of efficient rendering of complex lighting effects in real - time computer graphics, significantly improves the rendering speed, and at the same time maintains good visual quality.