Abstract:Many ecological systems dominated by stochastic dynamics can produce complex time series that inherently limit forecast accuracy. The 'intrinsic predictability' of these systems can be approximated by a time series complexity metric called weighted permutation entropy (WPE). While WPE is a useful metric to gauge forecast performance prior to model building, it is sensitive to noise and may be biased depending on the length of the time series. Here, we introduce a simple randomized permutation test (rWPE) to assess whether a time series is intrinsically more predictable than white noise. We apply rWPE to both simulated and empirical data to assess its performance and usefulness. To do this, we simulate population dynamics under various scenarios, including a linear trend, chaotic, periodic and equilibrium dynamics. We further test this approach with observed abundance time series for 932 species across four orders of animals from the Global Population Dynamics Database. Finally, using Adélie (Pygoscelis adeliae) and emperor penguin (Aptenodytes forsteri) time series as case studies, we demonstrate the application of rWPE to multiple populations for a single species. We show that rWPE can determine whether a system is significantly more predictable than white noise, even with time series as short as 10 years that show an apparent trend under biologically realistic stochasticity levels. Additionally, rWPE has statistical power close to 100% when time series are at least 30 time steps long and show chaotic or periodic dynamics. Power decreases to ~10% under equilibrium dynamics, irrespective of time series length. Among four classes of animal taxa, mammals have the highest relative frequency (28%) of time series that are both longer than 30 time steps and indistinguishable from white noise in terms of complexity, followed by insects (16%), birds (16%) and bony fishes (11%). rWPE is a straightforward and useful method widely applicable to any time series, including short ones. By informing forecasters of the inherent limitations to a system's predictability, it can guide a modeller's expectations for forecast performance.

New Method of Randomized Forecasting Using Entropy-Robust Estimation: Application to the World Population Prediction

Probabilistic Forecasting of Photovoltaic Generation: an Efficient Statistical Approach

On the generation of probabilistic forecasts from deterministic models

Nonparametric Stochastic Differential Equations for Ultra-Short-Term Probabilistic Forecasting of Wind Power Generation

Robust forecasting of mortality and fertility rates: A functional data approach

Accounting for Uncertainty About Past Values In Probabilistic Projections of the Total Fertility Rate for All Countries

Random forests with parametric entropy-based information gains for classification and regression problems

Application of the Robust Methods for Estimation of Distribution Parameters with a Priori Constraints on Parameters in Economics and Engineering

The value of probabilistic forecasting in emergency medical resource planning under uncertainty

Development of a Time Series Forecasting Method Based on Entropy Measures of Diagnostic Information

Ensemble Modeling for Time Series Forecasting: an Adaptive Robust Optimization Approach

Progress in Absorber R&D 2: Windows

Detecting stochasticity in population time series using a non‐parametric test of intrinsic predictability

Online Ensemble Approach for Probabilistic Wind Power Forecasting

Toward Robust Uncertainty Estimation with Random Activation Functions

Randomised Learning‐based Hybrid Ensemble Model for Probabilistic Forecasting of PV Power Generation

Solving the Random Pielou Logistic Equation with the Random Variable Transformation Technique: Theory and Applications

Bayesian Population Projections for the United Nations

An Ultra-short-term Wind Power Forecasting Method with Special Error Distribution

From Data to Decisions: Distributionally Robust Optimization Is Optimal

Robust Non-Parametric Mortality and Fertility Modelling and Forecasting: Gaussian Process Regression Approaches