Abstract:As a pivotal subfield within the domain of time series forecasting, runoff forecasting plays a crucial role in water resource management and scheduling. Recent advancements in the application of artificial neural networks (ANNs) and attention mechanisms have markedly enhanced the accuracy of runoff forecasting models. This article introduces an innovative hybrid model, ResTCN-DAM, which synergizes the strengths of deep residual network (ResNet), temporal convolutional networks (TCNs), and dual attention mechanisms (DAMs). The proposed ResTCN-DAM is designed to leverage the unique attributes of these three modules: TCN has outstanding capability to process time series data in parallel. By combining with modified ResNet, multiple TCN layers can be densely stacked to capture more hidden information in the temporal dimension. DAM module adeptly captures the interdependencies within both temporal and feature dimensions, adeptly accentuating relevant time steps/features while diminishing less significant ones with minimal computational cost. Furthermore, the snapshot ensemble method is able to obtain the effect of training multiple models through one single training process, which ensures the accuracy and robustness of the forecasts. The deep integration and collaborative cooperation of these modules comprehensively enhance the model's forecasting capability from various perspectives. Ablation studies conducted validate the efficacy of each module, and through multiple sets of comparative experiments, it is shown that the proposed ResTCN-DAM has exceptional and consistent performance across varying lead times. We also employ visualization techniques to display heatmaps of the model's weights, thereby enhancing the interpretability of the model. When compared with the prevailing neural network-based runoff forecasting models, ResTCN-DAM exhibits state-of-the-art accuracy, temporal robustness, and interpretability, positioning it at the forefront of contemporary research.

Time series change detection using reservoir computing networks for remote sensing data

A Comparative Study of Reservoir Computing for Temporal Signal Processing

Tipping Point Detection Using Reservoir Computing

A systematic exploration of reservoir computing for forecasting complex spatiotemporal dynamics

Reservoir computing dissection and visualization based on directed network embedding

Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics

Time series classification models based on nonlinear spiking neural P systems

An Integrated Reservoir Predictor Based on Spatiotemporal Information Transformation

Catch-22s of reservoir computing

A Comparison Between Reservoir Computing with Recurrent Analogs in Predicting Dynamical Systems

Reservoir computing models based on spiking neural P systems for time series classification

Hybridizing Traditional and Next-Generation Reservoir Computing to Accurately and Efficiently Forecast Dynamical Systems

Predicting unobserved climate time series data at distant areas via spatial correlation using reservoir computing

Embedding Theory of Reservoir Computing and Reducing Reservoir Network Using Time Delays

Residual Temporal Convolutional Network With Dual Attention Mechanism for Multilead-Time Interpretable Runoff Forecasting

Novel efficient reservoir computing methodologies for regular and irregular time series classification

An asynchronously deep reservoir computing for predicting chaotic time series

Detecting Causality from Time Series in a Machine Learning Framework

DDTCN: Decomposed dimension time-domain convolutional neural network along spatial dimensions for multiple long-term series forecasting

Backpropagation algorithms and Reservoir Computing in Recurrent Neural Networks for the forecasting of complex spatiotemporal dynamics

A novel Reservoir Architecture for Periodic Time Series Prediction