Abstract:It is necessary to accurately assess the inflow and infiltration conditions in sewer systems if sewer overflows are to be avoided. In this regard, Long Short-Term Memory (LSTM) is widely utilized for hydrological time-series forecasting. However, hydrological time-series have been found to be highly nonlinear and dynamic, such that the original LSTM model cannot simultaneously consider the spatiotemporal correlations of the input sequences for water flow rate forecasting. To address this problem, we propose using an LSTM with spatiotemporal attention (LSTM-STA) model, one based on encoder-decoder architecture, as this will allow accurate forecasting of the water flow rate. The encoder incorporates a spatial attention mechanism module allowing it to adaptively capture the key spatial attributes from all related spatial attributes at each time step. The decoder also incorporates a temporal attention mechanism module for dynamically discovering the key encoder hidden states from all time steps in the window. Using the spatiotemporal attention mechanism, the LSTM-STA model comprehensively considers all the important factors influencing the water flow rate forecasting, in both temporal and spatial dimensions. We performed extensive experiments; applying the LSTM-STA model to real-world hydrological time-series datasets, each one containing 52,704 sampled data points while leveraging state-of-the-art SVR-rbf, MLP, CNN1D, GRU, LSTM, Encoder-Decoder, LSTM-SA, and LSTM-TA as baselines. The experimental results demonstrated that the LSTM-STA model outperforms the state-of-the-art baseline models. Specifically, the LSTM-STA model yields the lowest RMSE, MAE, MAPE, and the highest R 2 in the test process, said values being 73.19, 33.37, 1.09, and 0.99858, respectively. We also verified the stability and hyperparameter sensitivity of the LSTM-STA model. Furthermore, we visualized the spatial attention weights and benefitted from spatial interpretability.

ISA-PredRNN: an Improved Self-Attention PredRNN Network for Spatiotemporal Predictive Learning

Short-Term Rainfall Prediction Based on Radar Echo Using an Improved Self-Attention PredRNN Deep Learning Model

PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs

PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning

Self-Attention ConvLSTM for Spatiotemporal Prediction

Enhancing spatiotemporal predictive learning: an approach with nested attention module

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

PredRANN: the Spatiotemporal Attention Convolution Recurrent Neural Network for Precipitation Nowcasting

SARNN: A Spatiotemporal Prediction Model for Reducing Error Transmissions

Triplet Attention Transformer for Spatiotemporal Predictive Learning

PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning

A Self-Attention Based Method for Wind Speed Forecasting in High-Speed Railway System

Revisiting the Temporal Modeling in Spatio-Temporal Predictive Learning under A Unified View

SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

SAM-Net: Spatio-Temporal Sequence Typhoon Cloud Image Prediction Net with Self-Attention Memory

TCSA-Net: A Temporal-Context-Based Self-Attention Network for Next Location Prediction

Bi-PredRNN: An Enhanced PredRNN++ with a Bidirectional Network for Spatiotemporal Sequence Prediction

MS-RNN: A Flexible Multi-Scale Framework for Spatiotemporal Predictive Learning

DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series prediction

LSTM with Spatiotemporal Attention for IoT-based Wireless Sensor Collected Hydrological Time-Series Forecasting