Abstract:Distribution forecasts P over future quantities or events are routinely made in hydrology but usually traded for a (likelihood‐weighted) mean or median prediction to accommodate error measures or scoring functions such as the mean absolute error or mean squared error. Case in point is the so‐called KG efficiency (KGE) of Gupta et al. (2009, https://doi.org/10.1016/j.jhydrol.2009.08.003) and improvements thereof (Lamontagne et al., 2020, https://doi.org/10.1029/2020wr027101), which have rapidly gained popularity among hydrologists as alternative scoring functions to the commonly used Nash and Sutcliffe (1970, https://doi.org/10.1016/0022‐1694(70)90255‐6) efficiency, but are equally exclusive in how they quantify model performance using only single‐valued output of the quantities of interest. This point‐valued mapping necessarily implies a loss of information about model performance. This paper advocates the use of probabilistic watershed model training, evaluation and diagnostics. Distribution evaluation opens a mature literature on scoring rules whose strong statistical underpinning provides, as we will demonstrate, the theory, context and guidelines necessary for the development of robust information‐theoretically principled metrics for watershed signatures. These so‐called hydrograph functionals are scalar‐valued mappings of major behavioral watershed functions embodied in a strictly proper scoring rule. We discuss past developments that led to the current state‐of‐the‐art of distribution evaluation in hydrology and review scoring rules for dichotomous and categorical events, quantiles (intervals) and density forecasts. We are particularly concerned with elicitable functionals and scoring rule propriety, discuss the decomposition of scoring rules into a sharpness, reliability and entropy term and present diagnostically appealing strictly proper divergence scores of hydrograph functionals for flood frequency analysis, flow duration and recession curves. The usefulness and power of distribution‐based model evaluation and diagnostics by means of scoring rules is demonstrated on simple illustrative problems and discharge distributions simulated with watershed models using random sampling and Bayesian model averaging. The presented theory (a) enables a more complete evaluation of distribution forecasts, (b) offers a statistically principled means for watershed model training, evaluation, diagnostics and selection using hydrograph functionals and/or extreme events and (c) provides a universal framework for metric development of watershed signatures, promoting metric standardization and reproducibility.

Proficiency of probability distributions in unit hydrograph derivation

Qualitative and Quantitative Uncertainties in Regional Rainfall Frequency Analysis

Application of an Improved Adaptive Importance Sampling Method in Extreme Hydrological Analysis

Analysis of the Inhomogeneity and Randomness of Rainfalls Based on the Double-rectangle Shaped Hyetograph

Numerical Approach for Water Distribution System Model Calibration Through Incorporation of Multiple Stochastic Prior Distributions.

Efficient joint probability analysis of flood risk

State-of-the-Art Statistical Approaches for Estimating Flood Events

A Hydrologic Uncertainty Processor Using Linear Derivation in the Normal Quantile Transform Space

Derived Flood Frequency Distributions Considering Individual Event Hydrograph Shapes

Parameter Estimation for Some Probability Distributions Used in Hydrology

Frequency Analysis of Extreme Events Using the Univariate Beta Family Probability Distributions

A note on the applicability of log-Gumbel and log-logistic probability distributions in hydrological analyses: II. Assumed pdf

Distribution‐Based Model Evaluation and Diagnostics: Elicitability, Propriety, and Scoring Rules for Hydrograph Functionals

A time-varying distributed unit hydrograph method considering soil moisture

Analysis of Probability Distributions for Modelling Extreme Rainfall Events and Detecting Climate Change: Insights from Mathematical and Statistical Methods

A genetic algorithm's novel rainfall distribution method for optimized hydrological modeling at basin scales

A Time-Varying Distributed Unit Hydrograph method considering soil moisture content

Hydrologic analysis of urban catchments with event-based probabilistic models: 1. Runoff volume

Hydrologic Analysis of Urban Catchments with Event‐based Probabilistic Models: 2. Peak Discharge Rate

Hydrological Drought Regimes of the Huai River Basin, China: Probabilistic Behavior, Causes and Implications

A probabilistic description of rain storms incorporating peak intensities