Abstract:From the nano-scale to the macro-scale, biological tissue is spatially heterogeneous. Even when tissue behavior is well understood, the exact subject specific spatial distribution of material properties is often unknown. And, when developing computational models of biological tissue, it is usually prohibitively computationally expensive to simulate every plausible spatial distribution of material properties for each problem of interest. Therefore, one of the major challenges in developing accurate computational models of biological tissue is capturing the potential effects of this spatial heterogeneity. Recently, machine learning based metamodels have gained popularity as a computationally tractable way to overcome this problem because they can make predictions based on a limited number of direct simulation runs. These metamodels are promising, but they often still require a high number of direct simulations to achieve an acceptable performance. Here we show that transfer learning, a strategy where knowledge gained while solving one problem is transferred to solving a different but related problem, can help overcome this limitation. Critically, transfer learning can be used to leverage both low-fidelity simulation data and simulation data that is the outcome of solving a different but related mechanical problem. In this paper, we extend Mechanical MNIST, our open source benchmark dataset of heterogeneous material undergoing large deformation, to include a selection of low-fidelity simulation results that require 2-4 orders of magnitude less CPU time to run. Then, we show that transferring the knowledge stored in metamodels trained on these low-fidelity simulation results can vastly improve the performance of metamodels used to predict the results of high-fidelity simulations.

Learning Detail Transfer based on Geometric Features

Non-parametric Filtering for Geometric Detail Extraction and Material Representation

DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesis

Deep Exemplar-Based Color Transfer for 3D Model

L0 Gradient-Preserving Color Transfer

TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion

Facial Geometric Detail Recovery via Implicit Representation

Exploring the potential of transfer learning for metamodels of heterogeneous material deformation

Geometry Transfer for Stylizing Radiance Fields

DECOLLAGE: 3D Detailization by Controllable, Localized, and Learned Geometry Enhancement

Deep Detail Enhancement for Any Garment

Geometric texture synthesis and transfer via geometry images

DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow

Multi-level Differential Surface Representation Based on Local Transformations

Texture Mapping on Real World Models from Multiple Photographic Images

Learning to Transfer Texture from Clothing Images to 3D Humans

2D Shape Blending Based on Multi-Level Feature Structures

Bas-relief modelling from enriched detail and geometry with deep normal transfer

Color Transfer Based on Earth Mover's Distance and Color Categorization

Instance-level Facial Attributes Transfer with Geometry-Aware Flow

Surface Geometry Processing: An Efficient Normal-based Detail Representation