Abstract:Accurately rendering the appearance of fabrics is challenging, due to their complex 3D microstructures and specialized optical properties. If we model the geometry and optics of fabrics down to the fiber level, we can achieve unprecedented rendering realism, but this raises the difficulty of authoring or capturing the fiber-level assets. Existing approaches can obtain fiber-level geometry with special devices (e.g., CT) or complex hand-designed procedural pipelines (manually tweaking a set of parameters). In this paper, we propose a unified framework to capture fiber-level geometry and appearance of woven fabrics using a single low-cost microscope image. We first use a simple neural network to predict initial parameters of our geometric and appearance models. From this starting point, we further optimize the parameters of procedural fiber geometry and an approximated shading model via differentiable rasterization to match the microscope photo more accurately. Finally, we refine the fiber appearance parameters via differentiable path tracing, converging to accurate fiber optical parameters, which are suitable for physically-based light simulations to produce high-quality rendered results. We believe that our method is the first to utilize differentiable rendering at the microscopic level, supporting physically-based scattering from explicit fiber assemblies. Our fabric parameter estimation achieves high-quality re-rendering of measured woven fabric samples in both distant and close-up views. These results can further be used for efficient rendering or converted to downstream representations. We also propose a patch-space fiber geometry procedural generation and a two-scale path tracing framework for efficient rendering of fabric scenes.

Modeling Yarn-Level Geometry from a Single Micro-Image

Computer Simulation of Fancy Yarns Based on Structural Model of Appearance

Investigation of Automated Geometry Modeling Process of Woven Fabrics Based on the Yarn Structures

Fiber-level Woven Fabric Capture from a Single Photo

Empirical Model for Matching Spectrophotometric Reflectance of Yarn Windings and Multispectral Imaging Reflectance of Single Strands of Yarns.

A Novel Method for Weft and Warp Yarn Segmentation in Multicolour Yarn‐dyed Fabric Images

An Efficient Method for Solid‐colour and Multicolour Region Segmentation in Real Yarn‐dyed Fabric Images

A Multi-scale Yarn Appearance Model with Fiber Details

A Multispectral Imaging Approach to Colour Measurement and Colour Matching of Single Yarns Without Winding

Multi-Scale Hybrid Micro-Appearance Modeling and Realtime Rendering of Thin Fabrics

Yarn level simulation of warp-knitted clothing elements – first results and challenges

An Unsupervised Method for Dominant Colour Region Segmentation in Yarn-Dyed Fabrics

Automatic reconstruction of closely packed fabric composite RVEs using yarn-level micro-CT images processed by convolutional neural networks (CNNs) and based on physical characteristics

Mechanics-Aware Modeling of Cloth Appearance

Color Specification of a Single Strand of Yarn from a Multispectral Image

Realistic Rendering and Animation of Knitwear

Computer Simulation of Brocade Based on Modeling Structures

Image-Based Reverse Engineering and Visual Prototyping of Woven Cloth

Multi-scale density detection for yarn-dyed fabrics with deformed repeat patterns

Photorealistic Rendering of Knitwear Using the Lumislice.

Detailed Garment Recovery from a Single-View Image