Abstract:We want to recreate spatially-varying bi-directional reflectance distribution functions (SVBRDFs) from a single image. Producing these SVBRDFs from single images will allow designers to incorporate many new materials in their virtual scenes, increasing their realism. A single image contains incomplete information about the SVBRDF, making reconstruction difficult. Existing algorithms can produce high-quality SVBRDFs with single or few input photographs using supervised deep learning. The learning step relies on a huge dataset with both input photographs and the ground truth SVBRDF maps. This is a weakness as ground truth maps are not easy to acquire. For practical use, it is also important to produce large SVBRDF maps. Existing algorithms rely on a separate texture synthesis step to generate these large maps, which leads to the loss of consistency between generated SVBRDF maps. In this paper, we address both issues simultaneously. We present an unsupervised generative adversarial neural network that addresses both SVBRDF capture from a single image and synthesis at the same time. From a low-resolution input image, we generate a large resolution SVBRDF, much larger than the input images. We train a generative adversarial network (GAN) to get SVBRDF maps, which have both a large spatial extent and detailed texels. We employ a two-stream generator that divides the training of maps into two groups (normal and roughness as one, diffuse and specular as the other) to better optimize those four maps. In the end, our method is able to generate high-quality large scale SVBRDF maps from a single input photograph with repetitive structures and provides higher quality rendering results with more details compared to the previous works. Each input for our method requires individual training, which costs about 3 hours. CCS Concepts • Computing methodologies → Texturing;

Modeling surface appearance from a single photograph using self-augmented convolutional neural networks

Ultra-High Resolution SVBRDF Recovery from a Single Image

Single-image SVBRDF capture with a rendering-aware deep network

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Neural Appearance Modeling From Single Images

Flexible SVBRDF Capture with a Multi‐Image Deep Network

SVBRDF Recovery from a Single Image with Highlights Using a Pre-trained Generative Adversarial Network

Joint SVBRDF Recovery and Synthesis from a Single Image Using an Unsupervised Generative Adversarial Network

Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation

Single‐Image SVBRDF Estimation with Learned Gradient Descent

Neural Reflectance for Shape Recovery with Shadow Handling

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

MatFusion: A Generative Diffusion Model for SVBRDF Capture

Guided Fine-Tuning for Large-Scale Material Transfer

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Two-Shot Spatially-Varying BRDF and Shape Estimation

SVBRDF Reconstruction by Transferring Lighting Knowledge

BRDF-NeRF: Neural Radiance Fields with Optical Satellite Images and BRDF Modelling

Self-supervised reflectance-guided 3d shape reconstruction from single-view images