Abstract:Techniques from the field of machine learning have shown considerable promise in rainfall-runoff modelling. This research offers three novel contributions to the advancement of this field: a study of the performance of LSTM based models in a GB hydrological context; a diagnosis of hydrological processes that data-driven models simulate well but conceptual models struggle with; and finally an exploration of methods for interpreting the internal cell states of the LSTMs.&#160;In this study we train two deep learning models, a Long Short Term Memory (LSTM) Network and an Entity Aware LSTM (EALSTM), to simulate discharge for 518 catchments across Great Britain using a newly published dataset, CAMELS-GB. We demonstrate that the LSTM models are capable of simulating discharge for a large sample of catchments across Great Britain, achieving a mean catchment Nash-Sutcliffe Efficiency (NSE) of 0.88 for the LSTM and 0.86 for the EALSTM, where no stations have an NSE < 0. We compare these models against a series of conceptual models which have been externally calibrated and used as a benchmark (Lane et al., 2019).&#160;Alongside robust performance for simulating discharge, we note the potential for data-driven methods to identify hydrological processes that are present in the underlying data, but the FUSE conceptual models are unable to capture. Therefore, we calculate the relative improvement of the LSTMs compared to the conceptual models, &#8710;NSE. We find that the largest improvement of the LSTM models compared to our benchmark is in the summer months and in the South East of Great Britain.&#160;We also demonstrate that the internal &#8220;memory&#8221; of the LSTM correlates with soil moisture, despite the LSTM not receiving soil moisture as an input. This process of &#8220;concept-formation&#8221; offers three interesting findings. It provides a novel method for deriving soil moisture estimates. It suggests the LSTM is learning physically realistic representations of hydrological processes. Finally, this process of concept formation offers the potential to explore how the LSTM is able to produce accurate simulations of discharge, and the transformations that are learned from inputs (temperature, precipitation) to outputs (discharge).References: Lane, R. A., Coxon, G., Freer, J. E., Wagener, T., Johnes, P. J., Bloomfield, J. P., Greene, S., Macleod, C. J., and Reaney, S. M.: Benchmarking the predictive capability of hydrological models for river flow and flood peak predictions across over 1000 catchments in Great Britain, Hydrology and Earth System Sciences, 23, 4011&#8211;4032, 2019.

Multi-Timescale LSTM for Rainfall–Runoff Forecasting

Rainfall-Runoff Prediction at Multiple Timescales with a Single Long Short-Term Memory Network

Daily Runoff Forecasting Using a Cascade Long Short-Term Memory Model that Considers Different Variables

Rainfall-runoff modeling using long short-term memory based step-sequence framework

High Temporal Resolution Rainfall Runoff Modelling Using Long-Short-Term-Memory (LSTM) Networks

Using LSTMs for climate change assessment studies on droughts and floods

A New Rainfall-Runoff Model Using Improved LSTM with Attentive Long and Short Lag-Time

Multi-Time-Scale Input Approaches for Hourly-Scale Rainfall-Runoff Modeling based on Recurrent Neural Networks

Rainfall-Runoff Modelling Based on Long Short-Term Memory (LSTM)

High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks

Deep Learning Integration of Multi-Model Forecast Precipitation Considering Long Lead Times

Real time probabilistic inundation forecasts using a LSTM neural network

Integrating geographic data and the SCS-CN method with LSTM networks for enhanced runoff forecasting in a complex mountain basin

A novel multi-step ahead forecasting model for flood based on time residual LSTM

RSDF-AM-LSTM: Regional Scale Division Rainfall Forecasting Using Attention and LSTM

Rainfall-Runoff Simulation and Interpretation in Great Britain using LSTMs

Deep learning rainfall-runoff predictions of extreme events

Rainfall prediction: A comparative analysis of modern machine learning algorithms for time-series forecasting

Improving LSTM Hydrological Modeling with Spatiotemporal Deep Learning and Multi-Task Learning: A Case Study of Three Mountainous Areas on the Tibetan Plateau

Rainfall-Runoff Short-Term Forecasting Method Based on LSTM

Daily Runoff Forecasting Using Ensemble Empirical Mode Decomposition and Long Short-Term Memory