Abstract:Because physics‐based models of dynamical systems are constrained to obey conservation laws, they must typically be fed long sequences of temporally consecutive (TC) data during model calibration and evaluation. When memory time scales are long (as in many physical systems), this requirement makes it difficult to ensure distributional similarity when partitioning the data into independent, TC, calibration and evaluation subsets. The consequence can be poor and/or uncertain model performance when applied to new situations. To address this issue, we propose a novel strategy for achieving robust and transferable model performance. Instead of partitioning the data into TC calibration and evaluation periods, the model is run in continuous simulation mode for the entire period, and specific time steps are assigned (via a deterministic data‐allocation approach) for use in computing the calibration and evaluation metrics. Generative adversarial testing shows that this approach results in consistent calibration and evaluation data subset distributions. When tested using three conceptual rainfall‐runoff models applied to 163 catchments representing a wide range of hydro‐climatic conditions, the proposed “distributionally consistent (DC)” strategy consistently resulted in better overall performance than achieved using the traditional “TC” strategy. Testing on independent data periods confirmed superior robustness and transferability of the DC‐calibrated models, particularly under conditions of larger runoff skewness. Because the approach is generally applicable to physics‐based models of dynamical systems, it has the potential to significantly improve the confidence associated with prediction and uncertainty estimates generated using such models.

Data Comparison with Many Degrees of Freedom: the FSV (feature Selective Validation) in Multiple Dimensions

Comparison of Data with Multiple Degrees of Freedom Utilizing the Feature Selective Validation Method

Analyzing Transient Phenomena in the Time Domain Using the Feature Selective Validation (FSV) Method

FSV: State of the Art and Current Research Fronts

Comparison of Three-Dimensional Datasets by Using the Generalized N-Dimensional ( N-D) Feature Selective Validation (FSV) Technique

Investigating Confidence Histograms and Classification in Fsv: Part Ii-Float Fsv

Improvement in the Definition of ODM for FSV

Achieving Robust and Transferable Performance for Conservation‐Based Models of Dynamical Physical Systems

A Statistical Assessment of the Performance of FSV

A Review on the Drawbacks and Enhancement Opportunities of the Feature Selective Validation

Applying the Analytic Hierarchy Process (AHP) to an FSV-Based Comparison of Multiple Datasets

Using Image Quality Assessment (IQA) Databases to Provide an Appraisal of the Ability of the Feature Selective Validation Method (FSV) to Compare Two-Dimensional Datasets

Notice of Retraction: Statistical Figures of Merit for the Feature Selective Validation Method

Adaptive Multifidelity Data Assimilation for Nonlinear Subsurface Flow Problems

A new computationally efficient algorithm to solve Feature Selection for Functional Data Classification in high-dimensional spaces

Variable Selection for Comparing High-dimensional Time-Series Data

Sequential Monte Carlo-based fidelity selection in dynamic-data-driven adaptive multi-scale simulations

Contour forward flux sampling: Sampling rare events along multiple collective variables

The Significance of Latent Data Divergence in Predicting System Degradation

Multi-subspace Factor Analysis Integrated with Support Vector Data Description for Multimode Process Monitoring.

Concurrent Monitoring of Operating Condition Deviations and Process Dynamics Anomalies with Slow Feature Analysis