Abstract:Procedural modeling is now the de facto standard of material modeling in industry. Procedural models can be edited and are easily extended, unlike pixel-based representations of captured materials. In this article, we present a semi-automatic pipeline for general material proceduralization. Given Spatially Varying Bidirectional Reflectance Distribution Functions (SVBRDFs) represented as sets of pixel maps, our pipeline decomposes them into a tree of sub-materials whose spatial distributions are encoded by their associated mask maps. This semi-automatic decomposition of material maps progresses hierarchically, driven by our new spectrum-aware material matting and instance-based decomposition methods. Each decomposed sub-material is proceduralized by a novel multi-layer noise model to capture local variations at different scales. Spatial distributions of these sub-materials are modeled either by a by-example inverse synthesis method recovering Point Process Texture Basis Functions (PPTBF) [ 30 ] or via random sampling. To reconstruct procedural material maps, we propose a differentiable rendering-based optimization that recomposes all generated procedures together to maximize the similarity between our procedural models and the input material pixel maps. We evaluate our pipeline on a variety of synthetic and real materials. We demonstrate our method’s capacity to process a wide range of material types, eliminating the need for artist designed material graphs required in previous work [ 38 , 53 ]. As fully procedural models, our results expand to arbitrary resolution and enable high-level user control of appearance.

Real-Time Linear BRDF MIP-Mapping

Image rendering method based on BRDF function linear filtering

Realtime Rendering Glossy to Glossy Reflections in Screen Space

Spatially Varying BRDF Map Filtering

Ultra-High Resolution SVBRDF Recovery from a Single Image

Normal Texture Editing Based on Shading Interval Constraints

Fast, Realistic Lighting and Material Design Using Nonlinear Cut Approximation

Parallel and Adaptive Visibility Sampling for Rendering Dynamic Scenes with Spatially Varying Reflectance.

Real-Time Rendering of Layered Materials with Linearly Filterable Reflectance Model.

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

Real‐time Denoising Using BRDF Pre‐integration Factorization

A svBRDF modeling pipeline using pixel clustering

3d Reconstruction With Multi-View Texture Mapping

Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields

A practical algorithm for rendering interreflections with all-frequency BRDFs

Output-coherent image-space LIC for surface flow visualization

Real-Time Multi-scale Refraction under All-Frequency Environmental Lighting

Multiple-bounce Smith Microfacet BRDFs using the Invariance Principle

Rendering With Spherical Radiance Transport Maps

Real-Time Rendering of Rough Refraction under Dynamically Varying Environmental Lighting

An Inverse Procedural Modeling Pipeline for SVBRDF Maps