Abstract:Understanding uncertainty is critical, especially when data are sparse and variations are large. Bayesian neural networks offer a powerful strategy to build predictable models from sparse data, and inherently quantify both, aleatoric uncertainties of the data and epistemic uncertainties of the model. Yet, classical Bayesian neural networks ignore the fundamental laws of physics, they are non-interpretable, and their parameters have no physical meaning. Here we integrate concepts of Bayesian learning and constitutive neural networks to discover interpretable models, parameters, and uncertainties that best explain soft matter systems. Instead of training an individual constitutive neural network and learning point values of the network weights, we train an ensemble of networks and learn probability distributions of the weights, along with their means, standard deviations, and credible intervals. We use variational Bayesian inference and adopt an efficient backpropagation-compatible algorithm that approximates the true probability distributions by simpler distributions and minimizes their divergence through variational learning. When trained on synthetic data, our Bayesian constitutive neural network successfully rediscovers the initial model, even in the presence of noise, and robustly discovers uncertainties, even from incomplete data. When trained on real data from healthy and aneurysmal human arteries, our network discovers a model with more stretch stiffening, more anisotropy, and more uncertainty for diseased than for healthy arteries. Our results demonstrate that Bayesian constitutive neural networks can successfully discriminate between healthy and diseased arteries, robustly discover interpretable models and parameters for both, and efficiently quantify uncertainties in model discovery. We anticipate our approach to generalize to other soft biomedical systems for which real-world data are rare and inter-personal variations are large. Ultimately, our calculated uncertainties will help enhance model robustness, promote personalized predictions, enable informed decision-making, and build confidence in automated model discovery and simulation.

Discovering uncertainty: Bayesian constitutive artificial neural networks

A new family of Constitutive Artificial Neural Networks towards automated model discovery

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks

A Bayesian method with nonlinear noise model to calibrate constitutive parameters of soft tissue

Bayesian neural networks for predicting uncertainty in full-field material response

Discovering biomedical causality by a generative Bayesian causal network under uncertainty

A variational Bayesian neural network for structural health monitoring and cost-informed decision-making in miter gates

Adversarial uncertainty quantification in physics-informed neural networks

BayesNetCNN: incorporating uncertainty in neural networks for image-based classification tasks

Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics

High Accuracy Uncertainty-Aware Interatomic Force Modeling with Equivariant Bayesian Neural Networks

A generic physics-informed neural network-based constitutive model for soft biological tissues

Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification

Artificial Neural Network (ANN) - Bayesian Probability Framework (BPF) Based Method of Dynamic Force Reconstruction under Multi-Source Uncertainties

A Kernel Framework to Quantify a Model's Local Predictive Uncertainty under Data Distributional Shifts

DropConnect Is Effective in Modeling Uncertainty of Bayesian Deep Networks

Scalable Bayesian Uncertainty Quantification for Neural Network Potentials: Promise and Pitfalls

Unified Bayesian network for uncertainty quantification of physiological parameters in dynamic contrast enhanced (DCE) MRI of the liver

Functional Bayesian Neural Networks for Model Uncertainty Quantification