Abstract:Techniques from the field of machine learning have shown considerable promise in rainfall-runoff modelling. This research offers three novel contributions to the advancement of this field: a study of the performance of LSTM based models in a GB hydrological context; a diagnosis of hydrological processes that data-driven models simulate well but conceptual models struggle with; and finally an exploration of methods for interpreting the internal cell states of the LSTMs.&#160;In this study we train two deep learning models, a Long Short Term Memory (LSTM) Network and an Entity Aware LSTM (EALSTM), to simulate discharge for 518 catchments across Great Britain using a newly published dataset, CAMELS-GB. We demonstrate that the LSTM models are capable of simulating discharge for a large sample of catchments across Great Britain, achieving a mean catchment Nash-Sutcliffe Efficiency (NSE) of 0.88 for the LSTM and 0.86 for the EALSTM, where no stations have an NSE < 0. We compare these models against a series of conceptual models which have been externally calibrated and used as a benchmark (Lane et al., 2019).&#160;Alongside robust performance for simulating discharge, we note the potential for data-driven methods to identify hydrological processes that are present in the underlying data, but the FUSE conceptual models are unable to capture. Therefore, we calculate the relative improvement of the LSTMs compared to the conceptual models, &#8710;NSE. We find that the largest improvement of the LSTM models compared to our benchmark is in the summer months and in the South East of Great Britain.&#160;We also demonstrate that the internal &#8220;memory&#8221; of the LSTM correlates with soil moisture, despite the LSTM not receiving soil moisture as an input. This process of &#8220;concept-formation&#8221; offers three interesting findings. It provides a novel method for deriving soil moisture estimates. It suggests the LSTM is learning physically realistic representations of hydrological processes. Finally, this process of concept formation offers the potential to explore how the LSTM is able to produce accurate simulations of discharge, and the transformations that are learned from inputs (temperature, precipitation) to outputs (discharge).References: Lane, R. A., Coxon, G., Freer, J. E., Wagener, T., Johnes, P. J., Bloomfield, J. P., Greene, S., Macleod, C. J., and Reaney, S. M.: Benchmarking the predictive capability of hydrological models for river flow and flood peak predictions across over 1000 catchments in Great Britain, Hydrology and Earth System Sciences, 23, 4011&#8211;4032, 2019.

Meta-LSTM in hydrology: Advancing runoff predictions through model-agnostic meta-learning

Optimizing flood predictions by integrating LSTM and physical-based models with mixed historical and simulated data

A hybrid rainfall-runoff model: integrating initial loss and LSTM for improved forecasting

Comprehensive Analysis for Long-Term Hydrological Simulation by Deep Learning Techniques and Remote Sensing

Enhanced LSTM model for daily runoff prediction in the upper huai river basin, china

Rainfall-runoff modeling using long short-term memory based step-sequence framework

A New Rainfall-Runoff Model Using Improved LSTM with Attentive Long and Short Lag-Time

A national-scale hybrid model for enhanced streamflow estimation – consolidating a physically based hydrological model with long short-term memory (LSTM) networks

Deep learning rainfall-runoff predictions of extreme events

Comprehensive comparison of artificial neural networks and long short-term memory networks for rainfall-runoff simulation

Comparison of Long Short Term Memory Networks and the Hydrological Model in Runoff Simulation

Coupling SWAT and LSTM for Improving Daily Streamflow Simulation in a Humid and Semi-humid River Basin

A Hybrid Model of Ensemble Empirical Mode Decomposition and Sparrow Search Algorithm-Based Long Short-Term Memory Neural Networks for Monthly Runoff Forecasting

Impact of Spatial Distribution Information of Rainfall in Runoff Simulation Using Deep-Learning Methods

Adaptability of machine learning methods and hydrological models to discharge simulations in data-sparse glaciated watersheds

Research on Runoff Simulations Using Deep-Learning Methods

Application, interpretability and prediction of machine learning method combined with LSTM and LightGBM-a case study for runoff simulation in an arid area

Towards Learning Universal, Regional, and Local Hydrological Behaviors via Machine-Learning Applied to Large-Sample Datasets

Machine Learning Improvement of Streamflow Simulation by Utilizing Remote Sensing Data and Potential Application in Guiding Reservoir Operation

High Temporal Resolution Rainfall Runoff Modelling Using Long-Short-Term-Memory (LSTM) Networks

Rainfall-Runoff Simulation and Interpretation in Great Britain using LSTMs