Abstract:Techniques from the field of machine learning have shown considerable promise in rainfall-runoff modelling. This research offers three novel contributions to the advancement of this field: a study of the performance of LSTM based models in a GB hydrological context; a diagnosis of hydrological processes that data-driven models simulate well but conceptual models struggle with; and finally an exploration of methods for interpreting the internal cell states of the LSTMs.&#160;In this study we train two deep learning models, a Long Short Term Memory (LSTM) Network and an Entity Aware LSTM (EALSTM), to simulate discharge for 518 catchments across Great Britain using a newly published dataset, CAMELS-GB. We demonstrate that the LSTM models are capable of simulating discharge for a large sample of catchments across Great Britain, achieving a mean catchment Nash-Sutcliffe Efficiency (NSE) of 0.88 for the LSTM and 0.86 for the EALSTM, where no stations have an NSE < 0. We compare these models against a series of conceptual models which have been externally calibrated and used as a benchmark (Lane et al., 2019).&#160;Alongside robust performance for simulating discharge, we note the potential for data-driven methods to identify hydrological processes that are present in the underlying data, but the FUSE conceptual models are unable to capture. Therefore, we calculate the relative improvement of the LSTMs compared to the conceptual models, &#8710;NSE. We find that the largest improvement of the LSTM models compared to our benchmark is in the summer months and in the South East of Great Britain.&#160;We also demonstrate that the internal &#8220;memory&#8221; of the LSTM correlates with soil moisture, despite the LSTM not receiving soil moisture as an input. This process of &#8220;concept-formation&#8221; offers three interesting findings. It provides a novel method for deriving soil moisture estimates. It suggests the LSTM is learning physically realistic representations of hydrological processes. Finally, this process of concept formation offers the potential to explore how the LSTM is able to produce accurate simulations of discharge, and the transformations that are learned from inputs (temperature, precipitation) to outputs (discharge).References: Lane, R. A., Coxon, G., Freer, J. E., Wagener, T., Johnes, P. J., Bloomfield, J. P., Greene, S., Macleod, C. J., and Reaney, S. M.: Benchmarking the predictive capability of hydrological models for river flow and flood peak predictions across over 1000 catchments in Great Britain, Hydrology and Earth System Sciences, 23, 4011&#8211;4032, 2019.

Deep learning rainfall-runoff predictions of extreme events

High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks

Physics-guided Deep Learning for Rainfall-Runoff Modeling by Considering Extreme Events and Monotonic Relationships

High Temporal Resolution Rainfall Runoff Modelling Using Long-Short-Term-Memory (LSTM) Networks

Capabilities of deep learning models on learning physical relationships: Case of rainfall-runoff modeling with LSTM

Spatially-distributed Deep Learning for rainfall-runoff modelling and system understanding

Using LSTMs for climate change assessment studies on droughts and floods

Rainfall-Runoff Prediction at Multiple Timescales with a Single Long Short-Term Memory Network

Prediction of Flow Based on a CNN-LSTM Combined Deep Learning Approach

Meta-LSTM in hydrology: Advancing runoff predictions through model-agnostic meta-learning

Physics Guided Machine Learning Methods for Hydrology

Rainfall-runoff modeling using long short-term memory based step-sequence framework

Rainfall-Runoff Simulation and Interpretation in Great Britain using LSTMs

Evaluation of deep learning models for Australian climate extremes: prediction of streamflow and floods

A deep learning technique-based data-driven model for accurate and rapid flood prediction

A national-scale hybrid model for enhanced streamflow estimation – consolidating a physically based hydrological model with long short-term memory (LSTM) networks

Enhanced LSTM model for daily runoff prediction in the upper huai river basin, china

Deep learning models to predict flood events in fast-flowing watersheds

Impact of Spatial Distribution Information of Rainfall in Runoff Simulation Using Deep-Learning Methods

An Extreme-Adaptive Time Series Prediction Model Based on Probability-Enhanced LSTM Neural Networks

Which riverine water quality parameters can be predicted by meteorologically-driven deep learning?