Abstract:Understanding uncertainty is critical, especially when data are sparse and variations are large. Bayesian neural networks offer a powerful strategy to build predictable models from sparse data, and inherently quantify both, aleatoric uncertainties of the data and epistemic uncertainties of the model. Yet, classical Bayesian neural networks ignore the fundamental laws of physics, they are non-interpretable, and their parameters have no physical meaning. Here we integrate concepts of Bayesian learning and constitutive neural networks to discover interpretable models, parameters, and uncertainties that best explain soft matter systems. Instead of training an individual constitutive neural network and learning point values of the network weights, we train an ensemble of networks and learn probability distributions of the weights, along with their means, standard deviations, and credible intervals. We use variational Bayesian inference and adopt an efficient backpropagation-compatible algorithm that approximates the true probability distributions by simpler distributions and minimizes their divergence through variational learning. When trained on synthetic data, our Bayesian constitutive neural network successfully rediscovers the initial model, even in the presence of noise, and robustly discovers uncertainties, even from incomplete data. When trained on real data from healthy and aneurysmal human arteries, our network discovers a model with more stretch stiffening, more anisotropy, and more uncertainty for diseased than for healthy arteries. Our results demonstrate that Bayesian constitutive neural networks can successfully discriminate between healthy and diseased arteries, robustly discover interpretable models and parameters for both, and efficiently quantify uncertainties in model discovery. We anticipate our approach to generalize to other soft biomedical systems for which real-world data are rare and inter-personal variations are large. Ultimately, our calculated uncertainties will help enhance model robustness, promote personalized predictions, enable informed decision-making, and build confidence in automated model discovery and simulation.

Active and transfer learning with partially Bayesian neural networks for materials and chemicals

Active Learning with Fully Bayesian Neural Networks for Discontinuous and Nonstationary Data

Bayesian semi-supervised learning for uncertainty-calibrated prediction of molecular properties and active learning

Entropy-based active learning of graph neural network surrogate models for materials properties

Uncertainty Quantification in Multivariable Regression for Material Property Prediction with Bayesian Neural Networks

A Bayesian graph convolutional network for reliable prediction of molecular properties with uncertainty quantification

Scalable Bayesian Uncertainty Quantification for Neural Network Potentials: Promise and Pitfalls

A penalized complexity prior for deep Bayesian transfer learning with application to materials informatics

High Accuracy Uncertainty-Aware Interatomic Force Modeling with Equivariant Bayesian Neural Networks

Bayesian Graph Neural Networks for Molecular Property Prediction

Bayesian neural networks for predicting uncertainty in full-field material response

Discovering uncertainty: Bayesian constitutive artificial neural networks

Probabilistic Neural Networks (PNNs) for Modeling Aleatoric Uncertainty in Scientific Machine Learning

Deep Bayesian Active Learning, A Brief Survey on Recent Advances

Uncertainty Assessment-Based Active Learning for Reliable Fire Detection Systems

Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Study

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Less is more: sampling chemical space with active learning

Efficient Exploration of Chemical Compound Space Using Active Learning for Prediction of Thermodynamic Properties of Alkane Molecules.

A Bayesian neural network for toxicity prediction