Abstract:Deep neural networks (DNNs) are often coupled with physics-based models or data-driven surrogate models to perform fault detection and health monitoring of systems in the low data regime. These models serve as digital twins to generate large quantities of data to train DNNs which would otherwise be difficult to obtain from the real-life system. However, such models can exhibit parametric uncertainty that propagates to the generated data. In addition, DNNs exhibit uncertainty in the parameters learnt during training. In such a scenario, the performance of the DNN model will be influenced by the uncertainty in the physics-based model as well as the parameters of the DNN. In this article, we quantify the impact of both these sources of uncertainty on the performance of the DNN. We perform explicit propagation of uncertainty in input data through all layers of the DNN, as well as implicit prediction of output uncertainty to capture the former. Furthermore, we adopt Monte Carlo dropout to capture uncertainty in DNN parameters. We demonstrate the approach for fault detection of power lines with a physics-based model, two types of input data and three different neural network architectures. We compare the performance of such uncertainty-aware probabilistic models with their deterministic counterparts. The results show that the probabilistic models provide important information regarding the confidence of predictions, while also delivering an improvement in performance over deterministic models.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the uncertainty problems encountered when using data generated by Digital Twin to train Deep Neural Networks (DNNs) in power line fault detection. Specifically: 1. **Uncertainty in data generation**: - Digital Twin models (such as physics - based models or data - driven surrogate models) are used to generate the large - scale data required for training DNNs. However, these models themselves have parameter uncertainties, which will be propagated into the generated data. 2. **Uncertainty of DNN model parameters**: - The parameters learned by DNNs during the training process also have uncertainties, which will affect the prediction performance of the model. These problems lead to the following challenges: - The model may be over - confident or under - confident about the prediction results. - When facing unseen real - system data, the model may have poor performance. Therefore, this paper proposes a method to quantify the impact of these two uncertainties on the DNN prediction performance, and captures these uncertainties through techniques such as explicit propagation of input uncertainty, implicit prediction of output uncertainty, and Monte Carlo Dropout. In addition, the article also shows how to apply this method to power line fault detection, and compares the performance of probabilistic models and deterministic models to verify its effectiveness. ### Specific problem description - **Uncertainty in data generation**: Since the parameters of Digital Twin models are adjusted based on limited real - system data, these models themselves carry uncertainties. This uncertainty will be reflected in the generated data, and then affect the performance of downstream tasks. - **Uncertainty of DNN model parameters**: The parameters learned by DNNs during the training process may also have uncertainties, especially when the amount of data is limited. This uncertainty will cause the model to have too high or too low confidence in the prediction results. To solve these problems, this paper proposes a framework that can explicitly introduce uncertainty during the training and evaluation process, thereby improving the reliability and performance of the model. ### Solutions - **Explicit propagation of input uncertainty**: Through the Assumed Density Filtering (ADF) method, the uncertainty of the input data is propagated to each layer of the DNN, thereby estimating the mean and variance of the output. - **Implicit prediction of output uncertainty**: By redesigning the last layer of the DNN so that it can predict the mean and variance of the output, thus considering heteroscedasticity (that is, the output uncertainty depends on the actual value of the input). - **Monte Carlo Dropout**: By multiple forward propagations and randomly dropping neurons, the uncertainty of DNN parameters is estimated. Through these methods, this paper provides a comprehensive framework to quantify and handle the uncertainties in Digital Twin - driven DNN models, thereby improving the performance and reliability of the model in power line fault detection.

Uncertainty-aware deep learning for digital twin-driven monitoring: Application to fault detection in power lines

Uncertainty-aware deep learning for reliable health monitoring in safety-critical energy systems

Uncertainty-Aware Deep Learning: A Promising Tool for Trustworthy Fault Diagnosis

Detecting and Diagnosing Incipient Building Faults Using Uncertainty Information from Deep Neural Networks

Physics-informed deep learning: A promising technique for system reliability assessment

An uncertainty-informed framework for trustworthy fault diagnosis in safety-critical applications

Multidimensional Uncertainty Quantification for Deep Neural Networks

Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoring

Quantifying Uncertainty in Deep Learning Classification with Noise in Discrete Inputs for Risk-Based Decision Making

Uncertainty-Aware Prediction Validator in Deep Learning Models for Cyber-Physical System Data

DropConnect Is Effective in Modeling Uncertainty of Bayesian Deep Networks

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data

Quantifying predictive uncertainty in damage classification for Nondestructive Evaluation using Bayesian approximation and deep learning

Surrogate modelling and uncertainty quantification based on multi-fidelity deep neural network

Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

Deep learning–based stochastic modelling and uncertainty analysis of fault networks

Hybrid deep fault detection and isolation: Combining deep neural networks and system performance models

Model Uncertainty Quantification for Reliable Deep Vision Structural Health Monitoring

Data-Driven Physics-Informed Neural Networks: A Digital Twin Perspective

Trustworthy Fault Diagnosis with Uncertainty Estimation through Evidential Convolutional Neural Networks