Abstract:Abstract Forecasting the El Niño-Southern Oscillation (ENSO) has been a subject of vigorous research due to the important role of the phenomenon in climate dynamics and its worldwide socioeconomic impacts. Over the past decades, numerous models for ENSO prediction have been developed, among which statistical models approximating ENSO evolution by linear dynamics have received significant attention owing to their simplicity and comparable forecast skill to first-principles models at short lead times. Yet, due to highly nonlinear and chaotic dynamics (particularly during ENSO initiation), such models have limited skill for longer-term forecasts beyond half a year. To resolve this limitation, here we employ a new nonparametric statistical approach based on analog forecasting, called kernel analog forecasting (KAF), which avoids assumptions on the underlying dynamics through the use of nonlinear kernel methods for machine learning and dimension reduction of high-dimensional datasets. Through a rigorous connection with Koopman operator theory for dynamical systems, KAF yields statistically optimal predictions of future ENSO states as conditional expectations, given noisy and potentially incomplete data at forecast initialization. Here, using industrial-era Indo-Pacific sea surface temperature (SST) as training data, the method is shown to successfully predict the Niño 3.4 index in a 1998–2017 verification period out to a 10-month lead, which corresponds to an increase of 3–8 months (depending on the decade) over a benchmark linear inverse model (LIM), while significantly improving upon the ENSO predictability “spring barrier”. In particular, KAF successfully predicts the historic 2015/16 El Niño at initialization times as early as June 2015, which is comparable to the skill of current dynamical models. An analysis of a 1300-yr control integration of a comprehensive climate model (CCSM4) further demonstrates that the enhanced predictability afforded by KAF holds over potentially much longer leads, extending to 24 months versus 18 months in the benchmark LIM. Probabilistic forecasts for the occurrence of El Niño/La Niña events are also performed and assessed via information-theoretic metrics, showing an improvement of skill over LIM approaches, thus opening an avenue for environmental risk assessment relevant in a variety of contexts.

Analog Forecasting with Dynamics-Adapted Kernels

Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniques

Adaptive Kpca Modeling of Nonlinear Systems

Kernel Analog Forecasting: Multiscale Test Problems

Predicting regional and pan-Arctic sea ice anomalies with kernel analog forecasting

A model-based approach for analog spatio-temporal dynamic forecasting

Featurizing Koopman Mode Decomposition For Robust Forecasting

Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components

Deep Probabilistic Koopman: Long-term time-series forecasting under periodic uncertainties

Tracking and forecasting oscillatory data streams using Koopman autoencoders and Kalman filtering

Forecasting of Nonlinear Dynamics Based on Symbolic Invariance

Extended-range statistical ENSO prediction through operator-theoretic techniques for nonlinear dynamics

An Analogue-Dynamical Long-Range Numerical Weather Prediction System Incorporating Historical Evolution

KODA: A Data-Driven Recursive Model for Time Series Forecasting and Data Assimilation using Koopman Operators

Data-driven probability density forecast for stochastic dynamical systems

Autoregressive with Slack Time Series Model for Forecasting a Partially-Observed Dynamical Time Series

Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting

Forecasting Dynamics by an Incomplete Equation of Motion and an Auto-Encoder Koopman Operator

Koopman Kernel Regression

Strategy and methodology of dynamical analogue prediction