Abstract:As a revolutionary tool leading to substantial changes across many areas, Machine Learning (ML) techniques have obtained growing attention in the field of hydrology due to their potentials to forecast time series. Moreover, a subfield of ML, Deep Learning (DL) is more concerned with datasets, algorithms and layered structures. Despite numerous applications of novel ML/DL techniques in discharge simulation, the uncertainty involved in ML/DL modeling has not drawn much attention, although it is an important issue. In this study, a framework is proposed to quantify uncertainty contributions of the sample set, ML approach, ML architecture and their interactions to multi-step time-series forecasting based on the analysis of variance (ANOVA) theory. Then a discharge simulation, using Recurrent Neural Networks (RNNs), is taken as an example. Long Short-Term Memory (LSTM) network, a state-of-the-art DL approach, was selected due to its outstanding performance in time-series forecasting, and compared with simple RNN. Besides, novel discharge forecasting architecture is designed by combining the expertise of hydrology and stacked DL structure, and compared with conventional design. Taking hourly discharge simulations of Anhe (China) catchment as a case study, we constructed five sample sets, chose two RNN approaches and designed two ML architectures. The results indicate that none of the investigated uncertainty sources are negligible and the influence of uncertainty sources varies with lead-times and discharges. LSTM demonstrates its superiority in discharge simulations, and the ML architecture is as important as the ML approach. In addition, some of the uncertainty is attributable to interactions rather than individual modeling components. The proposed framework can both reveal uncertainty quantification in ML/DL modeling and provide references for ML approach evaluation and architecture design in discharge simulations. It indicates uncertainty quantification is an indispensable task for a successful application of ML/DL.

Bayesian Recurrent Neural Network Models for Forecasting and Quantifying Uncertainty in Spatial-Temporal Data

RNN with Particle Flow for Probabilistic Spatio-temporal Forecasting

Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecasting

Understanding Uncertainty in Bayesian Deep Learning

A reliable Bayesian neural network for the prediction of reservoir thickness with quantified uncertainty

Uncertainty Estimation With Neural Processes for Meta-Continual Learning

Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks

Recurrent neural networks for dynamical systems: Applications to ordinary differential equations, collective motion, and hydrological modeling

Uncertainty Estimation and Calibration with Finite-State Probabilistic RNNs

Probabilistic forecast of nonlinear dynamical systems with uncertainty quantification

Uncertainty Quantification in Machine Learning Modeling for Multi-Step Time Series Forecasting: Example of Recurrent Neural Networks in Discharge Simulations

Bayesian neural networks for uncertainty quantification in remaining useful life prediction of systems with sensor monitoring

Backpropagation algorithms and Reservoir Computing in Recurrent Neural Networks for the forecasting of complex spatiotemporal dynamics

Modeling the spatio-temporal dynamics of land use change with recurrent neural networks

Adaptive Ensemble Learning of Spatiotemporal Processes with Calibrated Predictive Uncertainty: A Bayesian Nonparametric Approach

Functional Bayesian Neural Networks for Model Uncertainty Quantification

Scalable Spatiotemporal Prediction with Bayesian Neural Fields

A General Framework for Uncertainty Quantification via Neural SDE-RNN

Spatial Bayesian Neural Networks

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Uncertainty Quantification of Locally Nonlinear Dynamical Systems using Neural Networks