Abstract:The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. We found that augmenting the training dataset using VAEs has improved the DNN model's predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Neural networks-based variationally enhanced sampling

Deep learning for variational multiscale molecular modeling

Variance extrapolation method for neural-network variational Monte Carlo

Deep Learning for Variational Multi-Scale Molecular Modeling

Variational neural annealing

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

A computational framework for neural network-based variational Monte Carlo with Forward Laplacian

Enhancing Open Quantum Dynamics Simulations Using Neural Network-Based Non-Markovian Stochastic Schrödinger Equation Method

Variational Tensor Network Simulation of Gaussian Boson Sampling and Beyond

Transferable Neural Networks for Enhanced Sampling of Protein Dynamics

Neural Network and Nearest Neighbor Algorithms for Enhancing Sampling of Molecular Dynamics

A Unified Approach to Enhanced Sampling

Enhancing variational Monte Carlo using a programmable quantum simulator

Accelerated Sampling of Rare Events using a Neural Network Bias Potential

An Investigation on Machine Learning Predictive Accuracy Improvement and Uncertainty Reduction using VAE-based Data Augmentation

Superposition Enhanced Nested Sampling

Fast Inference Using Automatic Differentiation and Neural Transport in Astroparticle Physics

A Unified Particle-Optimization Framework for Scalable Bayesian Sampling

Enhancing the Expressivity of Variational Neural, and Hardware-Efficient Quantum States Through Orbital Rotations

Variational Autoencoders for Efficient Simulation-Based Inference

Forward Laplacian: A New Computational Framework for Neural Network-based Variational Monte Carlo