Probabilistic Transfer Learning Through Ensemble Probabilistic Deep Neural Network

Sandipp Krishnan Ravi,Piyush Pandita,Sayan Ghosh,Anindya Bhaduri,Valeria Andreoli,Liping Wang
DOI: https://doi.org/10.2514/6.2023-1479
2023-01-01
Abstract:Design optimization has been a long standing endeavor of engineers and designers. With the advent of machine learning methods, impactful progress has been made towards building surrogate models that aid in the whole optimization paradigm. However one major hinderance that still exists is the perennial problem of data-scarcity driven by high computational/monetary costs. The paper seeks to support the efforts by tackling the problem through the domains of probabilistic modeling and transfer learning. The probabilistic modeling perspective seeks to augment the data-scarcity through uncertainty bounds. On the other hand, transfer learning approaches leverage a set of legendary/low fidelity data to augment for the shortage of data. Combining both the paradigm will aid in realizing a model that can leverage legacy data and at the same time provide insight into the uncertainty leading to stable and trustable models. The work done in the paper explores the paradigms of probabilistic transfer learning through two comprehensive case studies conducted on efficiency characteristics of a 2D airfoil and compressed stress states of a 3D airfoil. Additionally, key insights are provided on the effect of source domain and target domain data sizes not only on conventional the model performance metrics but also on the predictive uncertainty characteristics of the model.
What problem does this paper attempt to address?