Abstract:Accurate and scalable hydrologic models are essential building blocks of several important applications, from water resource management to timely flood warnings. In this work we present a novel family of hydrologic models, called HydroNets, that leverages river network connectivity structure within deep neural architectures. The injection of this connectivity structure prior knowledge allows for scalable and accurate hydrologic modeling.Prior knowledge plays an important role in machine learning and AI. On one extreme of the prior knowledge spectrum there are expert systems, which exclusively rely on domain expertise encoded into a model. On the other extreme there are general purpose agnostic machine learning methods, which are exclusively data-driven, without intentional utilization of inductive bias for the problem at hand. In the context of hydrologic modeling, conceptual models such as the Sacramento Soil Moisture Accounting Model (SAC-SMA) are closer to expert systems. Such models require explicit functional modeling of water volume flow in terms of their input variables and model parameters (e.g., precipitation, hydraulic conductivity, etc.) which could be calibrated using data. Instances of agnostic methods for stream flow hydrologic modelling, which for the most part do not utilize problem specific bias, have recently been presented by Kratzert et al. (2018, 2019) and by Shalev et al. (2019). These works showed that general purpose deep recurrent neural networks, such as long short-term models (LSTMs), can achieve state-of-the-art hydrologic forecasts at scale with less information.One of the fundamental reasons for the success of deep neural architectures in most application domains is the incorporation of prior knowledge into the architecture itself. This is, for example, the case in machine vision where convolutional layers and max pooling manifest essential invariances of visual perception. In this work we present HydroNets, a family of neural network models for hydrologic forecasting. HydroNets leverage the inherent (graph-theoretic) tree structure of river water flow, existing in any multi-site hydrologic basin. The network architecture itself reflects river network connectivity and catchment structures such that each sub-basin is represented as a tree node, and edges represent water flow from sub-basins to their containing basin. HydroNets are constructed such that all nodes utilize a shared global model component, as well as site-specific sub-models for local modulations. HydroNets thus combine two signals: site specific rainfall-runoff and upstream network dynamics, which can lead to improved predictions at longer horizons. Moreover, the proposed architecture, with its shared global model, tend to reduce sample complexity, increase scalability, and allows for transferability to sub-basins that suffer from scarce historical data. We present several simulation results over multiple basins in both India and the USA that convincingly support the proposed model and its advantages.

Deep neural networks of transformer architecture in problems of hydrological forecasts

Prediction of Urban Groundwater Level Based on CNN-Transformer

Transformer neural networks for interpretable flood forecasting

Enhancing hydrological modeling with transformers: a case study for 24-h streamflow prediction

Hypertuned temporal fusion transformer for multi-horizon time series forecasting of dam level in hydroelectric power plants

Graph Transformer Network for Flood Forecasting with Heterogeneous Covariates

A Transformer variant for multi-step forecasting of water level and hydrometeorological sensitivity analysis based on explainable artificial intelligence technology

Temporal Fusion Transformers for Streamflow Prediction: Value of Combining Attention with Recurrence

Real-time flood maps forecasting for dam-break scenarios with a transformer-based deep learning model

Behavior of LSTM and transformer deep learning models in flood simulation considering South Asian tropical climate

Advancing climate-resilient flood mitigation: Utilizing transformer-LSTM for water level forecasting at pumping stations

Monthly-scale hydro-climatic forecasting and climate change impact evaluation based on a novel DCNN-Transformer network

Deep Learning Hydrodynamic Forecasting for Flooded Region Assessment in Near-Real-Time (DL Hydro-FRAN)

Probing the limit of hydrologic predictability with the Transformer network

Transformer Versus LSTM: A Comparison of Deep Learning Models for Karst Spring Discharge Forecasting

HydroNets: Leveraging River Network Structure and Deep Neural Networks for Hydrologic Modeling

Convolutional Neural Networks for forecasting flood process in Internet-of-Things enabled smart city

Towards Generalized Hydrological Forecasting using Transformer Models for 120-Hour Streamflow Prediction

Advanced streamflow forecasting for Central European Rivers: The Cutting-Edge Kolmogorov-Arnold networks compared to Transformers

Flood forecasting based on an artificial neural network scheme