Abstract:Techniques from the field of machine learning have shown considerable promise in rainfall-runoff modelling. This research offers three novel contributions to the advancement of this field: a study of the performance of LSTM based models in a GB hydrological context; a diagnosis of hydrological processes that data-driven models simulate well but conceptual models struggle with; and finally an exploration of methods for interpreting the internal cell states of the LSTMs.&#160;In this study we train two deep learning models, a Long Short Term Memory (LSTM) Network and an Entity Aware LSTM (EALSTM), to simulate discharge for 518 catchments across Great Britain using a newly published dataset, CAMELS-GB. We demonstrate that the LSTM models are capable of simulating discharge for a large sample of catchments across Great Britain, achieving a mean catchment Nash-Sutcliffe Efficiency (NSE) of 0.88 for the LSTM and 0.86 for the EALSTM, where no stations have an NSE < 0. We compare these models against a series of conceptual models which have been externally calibrated and used as a benchmark (Lane et al., 2019).&#160;Alongside robust performance for simulating discharge, we note the potential for data-driven methods to identify hydrological processes that are present in the underlying data, but the FUSE conceptual models are unable to capture. Therefore, we calculate the relative improvement of the LSTMs compared to the conceptual models, &#8710;NSE. We find that the largest improvement of the LSTM models compared to our benchmark is in the summer months and in the South East of Great Britain.&#160;We also demonstrate that the internal &#8220;memory&#8221; of the LSTM correlates with soil moisture, despite the LSTM not receiving soil moisture as an input. This process of &#8220;concept-formation&#8221; offers three interesting findings. It provides a novel method for deriving soil moisture estimates. It suggests the LSTM is learning physically realistic representations of hydrological processes. Finally, this process of concept formation offers the potential to explore how the LSTM is able to produce accurate simulations of discharge, and the transformations that are learned from inputs (temperature, precipitation) to outputs (discharge).References: Lane, R. A., Coxon, G., Freer, J. E., Wagener, T., Johnes, P. J., Bloomfield, J. P., Greene, S., Macleod, C. J., and Reaney, S. M.: Benchmarking the predictive capability of hydrological models for river flow and flood peak predictions across over 1000 catchments in Great Britain, Hydrology and Earth System Sciences, 23, 4011&#8211;4032, 2019.

Green Roof Hydrological Modelling With GRU and LSTM Networks

A critical review of RNN and LSTM variants in hydrological time series predictions

High Temporal Resolution Rainfall Runoff Modelling Using Long-Short-Term-Memory (LSTM) Networks

Short-term runoff prediction with GRU and LSTM networks without requiring time step optimization during sample generation

Evaluating different machine learning methods to simulate runoff from extensive green roofs

Machine Learning Improvement of Streamflow Simulation by Utilizing Remote Sensing Data and Potential Application in Guiding Reservoir Operation

Comprehensive Analysis for Long-Term Hydrological Simulation by Deep Learning Techniques and Remote Sensing

Comprehensive comparison of artificial neural networks and long short-term memory networks for rainfall-runoff simulation

High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks

Rainfall-Runoff Simulation and Interpretation in Great Britain using LSTMs

Enhancing long short-term memory (LSTM)-based streamflow prediction with a spatially distributed approach

Comparison of Long Short Term Memory Networks and the Hydrological Model in Runoff Simulation

Improving LSTM Hydrological Modeling with Spatiotemporal Deep Learning and Multi-Task Learning: A Case Study of Three Mountainous Areas on the Tibetan Plateau

TreeLSTM: A spatiotemporal machine learning model for rainfall-runoff estimation

Toward interpretable LSTM-based modeling of hydrological systems

NeuralHydrology -- Interpreting LSTMs in Hydrology

Adaptability of machine learning methods and hydrological models to discharge simulations in data-sparse glaciated watersheds

Rainfall-runoff modeling using long short-term memory based step-sequence framework

Impact of Spatial Distribution Information of Rainfall in Runoff Simulation Using Deep-Learning Methods

Multivariate Streamflow Simulation Using Hybrid Deep Learning Models

Improvement of streamflow simulation by combining physically hydrological model with deep learning methods in data-scarce glacial river basin