Abstract:Abstract. Despite the great success of machine learning, its applications in climate dynamics have not been well developed. One concern might be how well the trained neural networks could learn a dynamical system and what can be the potential applications of this kind of learning. Detailed studies show that the coupling relations or dynamics among variables in linear or nonlinear systems can be well learnt by reservoir computer (RC) and long short-term memory (LSTM) machine learning, and these learnt coupling relations can be further applied to reconstruct one series from the other dominated by common coupling dynamics. In order to validate the above conclusions, toy models are applied to address the following three questions: (i) what can be learnt from different dynamical time series by machine learning; (ii) what factors significantly influence machine learning reconstruction; and (iii) how to select suitable explanatory or input variables for the reconstructed variable for machine learning. The results from these toy models show that both of RC and LSTM can indeed learn coupling relations among variables, and the learnt implicit coupling relation can be applied to accurately reconstruct one series from the other. Both of linear and nonlinear coupling relations between variables can influence the quality of the reconstructed series. If there is a strong linear coupling between variables, all of variables can be taken as explanatory variables for the reconstructed variable, and the reconstruction can be bi-directional. However, when the linear coupling among variables is much weaker, but with stronger nonlinear causality among variables, the reconstruction quality is direction-dependent and it may be only uni-directional. We propose using convergent cross mapping causality (CCM) index ρa→b to determine which variable can be taken as the reconstructed one and which can be taken as the explanatory variable. For example, the Pearson correlation between the average Tropical Surface Air Temperature (TSAT) and the average Northern Hemispheric SAT (NHSAT) is as weak as 0.08, but the CCM index of that NHSAT cross maps TSAT is ρN→T = 0.70, it means that NHSAT could be taken as the explanatory variable. Then we find that TSAT can be well reconstructed from NHSAT by means of RC. However, the reconstruction quality in the opposite direction is poor, because the CCM index of that TSAT cross maps NHSAT is only ρT→N = 0.24. These results also provide insights on machine learning approaches for paleoclimate reconstruction, parameterization scheme, and prediction in related climate studies.

Systematic identification of causal relations in high-dimensional chaotic systems: application to stratosphere-troposphere coupling

Estimating time-dependent structures in a multi-variate causality for land-atmosphere interactions

Distinguishing Time-Delayed Causal Interactions Using Convergent Cross Mapping

Causal inference from cross-sectional earth system data with geographical convergent cross mapping

Estimating Time-Dependent Structures in a Multivariate Causality for Land–Atmosphere Interactions

Causalized Convergent Cross Mapping and Its Implementation in Causality Analysis

A data-driven framework for dimensionality reduction and causal inference in climate fields

A comparison of two causal methods in the context of climate analyses

Data-driven dimensionality reduction and causal inference for spatiotemporal climate fields

Spatial Convergent Cross Mapping to Detect Causal Relationships from Short Time Series.

Causation Inference in Complicated Atmospheric Environment

A Liang-Kleeman Causality Analysis based on Linear Inverse Modeling

Detecting the Non‐Separable Causality in Soil Moisture‐Precipitation Coupling With Convergent Cross‐Mapping

A Time-Varying Causality Formalism Based on the Liang–Kleeman Information Flow for Analyzing Directed Interactions in Nonstationary Climate Systems

Detecting Causality in the Frequency Domain with Cross-Mapping Coherence

Conditional cross-map-based technique: From pairwise dynamical causality to causal network reconstruction

Detecting Causality from Time Series in a Machine Learning Framework

Reconstructing coupled time series in climate systems by machine learning

Partial Cross Mapping Eliminates Indirect Causal Influences

Accurate Attribution and Seasonal Prediction of Climatic Anomalies Using Causal Inference Theory

Causal networks for climate model evaluation and constrained projections