Abstract:As a pivotal subfield within the domain of time series forecasting, runoff forecasting plays a crucial role in water resource management and scheduling. Recent advancements in the application of artificial neural networks (ANNs) and attention mechanisms have markedly enhanced the accuracy of runoff forecasting models. This article introduces an innovative hybrid model, ResTCN-DAM, which synergizes the strengths of deep residual network (ResNet), temporal convolutional networks (TCNs), and dual attention mechanisms (DAMs). The proposed ResTCN-DAM is designed to leverage the unique attributes of these three modules: TCN has outstanding capability to process time series data in parallel. By combining with modified ResNet, multiple TCN layers can be densely stacked to capture more hidden information in the temporal dimension. DAM module adeptly captures the interdependencies within both temporal and feature dimensions, adeptly accentuating relevant time steps/features while diminishing less significant ones with minimal computational cost. Furthermore, the snapshot ensemble method is able to obtain the effect of training multiple models through one single training process, which ensures the accuracy and robustness of the forecasts. The deep integration and collaborative cooperation of these modules comprehensively enhance the model's forecasting capability from various perspectives. Ablation studies conducted validate the efficacy of each module, and through multiple sets of comparative experiments, it is shown that the proposed ResTCN-DAM has exceptional and consistent performance across varying lead times. We also employ visualization techniques to display heatmaps of the model's weights, thereby enhancing the interpretability of the model. When compared with the prevailing neural network-based runoff forecasting models, ResTCN-DAM exhibits state-of-the-art accuracy, temporal robustness, and interpretability, positioning it at the forefront of contemporary research.

Improved Convolutional Neural Network and its Application in Non-Periodical Runoff Prediction

Prediction of Urban Groundwater Level Based on CNN-Transformer

New Fuzzy Neural Network-Markov Model And Application In Mid- To Long-Term Runoff Forecast

Runoff Prediction for Hydrological Applications Using an INFO-Optimized Deep Learning Model

Evaluation and Interpretation of Runoff Forecasting Models Based on Hybrid Deep Neural Networks

Runoff Forecasting using Convolutional Neural Networks and optimized Bi-directional Long Short-term Memory

Improved artificial neural network model for hydrologic time series prediction

An improved nonlinear dynamical model for monthly runoff prediction for data scarce basins

Downstream Water Level Prediction of Reservoir Based on Convolutional Neural Network and Long Short-Term Memory Network

Multivariable Water Level Prediction Model Based on Convolution Radial Basis Network

Monthly Streamflow Forecasting Using Convolutional Neural Network

Deep insight into daily runoff forecasting based on a CNN-LSTM model

Daily runoff forecasting based on data-augmented neural network model

Long-term prediction of runoff based on Bayesian regulation neural network

Convolutional Neural Networks for forecasting flood process in Internet-of-Things enabled smart city

Residual Temporal Convolutional Network With Dual Attention Mechanism for Multilead-Time Interpretable Runoff Forecasting

A short-term flood prediction based on spatial deep learning network: A case study for Xi County, China

Comprehensive Analysis for Long-Term Hydrological Simulation by Deep Learning Techniques and Remote Sensing

A Hydrological Process-Based Neural Network Model for Hourly Runoff Forecasting

Application of a novel artificial neural network model in flood forecasting

Real-time Water Level Prediction of Cascaded Channels Based on Multilayer Perception and Recurrent Neural Network