Abstract:The long short-term memory network (LSTM) model alleviates the gradient vanishing or exploding problem of the recurrent neural network (RNN) model with gated unit architecture. It has been applied to flood forecasting work. However, flood data have the characteristic of unidirectional sequence transmission, and the gated unit architecture of the LSTM model establishes connections across different time steps which may not capture the physical mechanisms or be easily interpreted for this kind of data. Therefore, this paper investigates whether the gated unit architecture has a positive impact and whether LSTM is still better than RNN in flood forecasting work. We establish LSTM and RNN models, analyze the structural differences and impacts of the two models in transmitting flood data, and compare their performance in flood forecasting work. We also apply hyperparameter optimization and attention mechanism coupling techniques to improve the models, and establish an RNN model for optimizing hyperparameters using BOA (BOA-RNN), an LSTM model for optimizing hyperparameters using BOA (BOA-LSTM), an RNN model with MHAM in the hidden layer (MHAM-RNN), and an LSTM model with MHAM in the hidden layer (MHAM-LSTM) using the Bayesian optimization algorithm (BOA) and the multi-head attention mechanism (MHAM), respectively, to further examine the effects of RNN and LSTM as the underlying models and of cross-time scale bridging for flood forecasting. We use the measured flood process data of LouDe and HuaYuankou stations in the Yellow River basin to evaluate the models. The results show that compared with the LSTM model, under the 1 h forecast period of the LouDe station, the RNN model with the same structure and hyperparameters improves the four performance indicators of the Nash–Sutcliffe efficiency coefficient (NSE), the Kling-Gupta efficiency coefficient (KGE), the mean absolute error (MAE), and the root mean square error (RMSE) by 1.72%, 4.43%, 35.52% and 25.34%, respectively, and the model performance of the HuaYuankou station also improves significantly. In addition, under different situations, the RNN model outperforms the LSTM model in most cases. The experimental results suggest that the simple internal structure of the RNN model is more suitable for flood forecasting work, while the cross-time bridging methods such as gated unit architecture may not match well with the flood propagation process and may have a negative impact on the flood forecasting accuracy. Overall, the paper analyzes the impact of model architecture on flood forecasting from multiple perspectives and provides a reference for subsequent flood forecasting modeling.

PAPR Reduction in OFDM Systems Using Active Constellation Extension and Subcarrier Grouping Techniques

High Temporal Resolution Rainfall Runoff Modelling Using Long-Short-Term-Memory (LSTM) Networks

High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks

Green Roof Hydrological Modelling With GRU and LSTM Networks

Long short-term memory (LSTM) recurrent neural network for low-flow hydrological time series forecasting

A novel multi-step ahead forecasting model for flood based on time residual LSTM

Applications of machine learning to water resources management: A review of present status and future opportunities

A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

Streamflow modelling and forecasting for Canadian watersheds using LSTM networks with attention mechanism

Enhancing long short-term memory (LSTM)-based streamflow prediction with a spatially distributed approach

Hydrological Time Series Prediction Model Based on Attention-LSTM Neural Network

Comparative Analysis of Recurrent Neural Network Architectures for Reservoir Inflow Forecasting

Estimating water levels and discharges in tidal rivers and estuaries: Review of machine learning approaches

Rainfall and runoff time-series trend analysis using LSTM recurrent neural network and wavelet neural network with satellite-based meteorological data: case study of Nzoia hydrologic basin

A review of deep learning and machine learning techniques for hydrological inflow forecasting

Time Series Predictions in Unmonitored Sites: A Survey of Machine Learning Techniques in Water Resources

Is the LSTM Model Better than RNN for Flood Forecasting Tasks? A Case Study of HuaYuankou Station and LouDe Station in the Lower Yellow River Basin

Toward Routing River Water in Land Surface Models with Recurrent Neural Networks

NeuralHydrology -- Interpreting LSTMs in Hydrology

Integration of a Parsimonious Hydrological Model with Recurrent Neural Networks for Improved Streamflow Forecasting

Comprehensive comparison of artificial neural networks and long short-term memory networks for rainfall-runoff simulation