Uncertainty-aware deep learning for digital twin-driven monitoring: Application to fault detection in power lines

Laya Das,Blazhe Gjorgiev,Giovanni Sansavini
2023-03-20
Abstract:Deep neural networks (DNNs) are often coupled with physics-based models or data-driven surrogate models to perform fault detection and health monitoring of systems in the low data regime. These models serve as digital twins to generate large quantities of data to train DNNs which would otherwise be difficult to obtain from the real-life system. However, such models can exhibit parametric uncertainty that propagates to the generated data. In addition, DNNs exhibit uncertainty in the parameters learnt during training. In such a scenario, the performance of the DNN model will be influenced by the uncertainty in the physics-based model as well as the parameters of the DNN. In this article, we quantify the impact of both these sources of uncertainty on the performance of the DNN. We perform explicit propagation of uncertainty in input data through all layers of the DNN, as well as implicit prediction of output uncertainty to capture the former. Furthermore, we adopt Monte Carlo dropout to capture uncertainty in DNN parameters. We demonstrate the approach for fault detection of power lines with a physics-based model, two types of input data and three different neural network architectures. We compare the performance of such uncertainty-aware probabilistic models with their deterministic counterparts. The results show that the probabilistic models provide important information regarding the confidence of predictions, while also delivering an improvement in performance over deterministic models.
Machine Learning,Systems and Control
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to solve the uncertainty problems encountered when using data generated by Digital Twin to train Deep Neural Networks (DNNs) in power line fault detection. Specifically: 1. **Uncertainty in data generation**: - Digital Twin models (such as physics - based models or data - driven surrogate models) are used to generate the large - scale data required for training DNNs. However, these models themselves have parameter uncertainties, which will be propagated into the generated data. 2. **Uncertainty of DNN model parameters**: - The parameters learned by DNNs during the training process also have uncertainties, which will affect the prediction performance of the model. These problems lead to the following challenges: - The model may be over - confident or under - confident about the prediction results. - When facing unseen real - system data, the model may have poor performance. Therefore, this paper proposes a method to quantify the impact of these two uncertainties on the DNN prediction performance, and captures these uncertainties through techniques such as explicit propagation of input uncertainty, implicit prediction of output uncertainty, and Monte Carlo Dropout. In addition, the article also shows how to apply this method to power line fault detection, and compares the performance of probabilistic models and deterministic models to verify its effectiveness. ### Specific problem description - **Uncertainty in data generation**: Since the parameters of Digital Twin models are adjusted based on limited real - system data, these models themselves carry uncertainties. This uncertainty will be reflected in the generated data, and then affect the performance of downstream tasks. - **Uncertainty of DNN model parameters**: The parameters learned by DNNs during the training process may also have uncertainties, especially when the amount of data is limited. This uncertainty will cause the model to have too high or too low confidence in the prediction results. To solve these problems, this paper proposes a framework that can explicitly introduce uncertainty during the training and evaluation process, thereby improving the reliability and performance of the model. ### Solutions - **Explicit propagation of input uncertainty**: Through the Assumed Density Filtering (ADF) method, the uncertainty of the input data is propagated to each layer of the DNN, thereby estimating the mean and variance of the output. - **Implicit prediction of output uncertainty**: By redesigning the last layer of the DNN so that it can predict the mean and variance of the output, thus considering heteroscedasticity (that is, the output uncertainty depends on the actual value of the input). - **Monte Carlo Dropout**: By multiple forward propagations and randomly dropping neurons, the uncertainty of DNN parameters is estimated. Through these methods, this paper provides a comprehensive framework to quantify and handle the uncertainties in Digital Twin - driven DNN models, thereby improving the performance and reliability of the model in power line fault detection.