Abstract:Classical palaeoenvironmental reconstruction models often incorporate biological ideas and commonly assume that the taxa comprising a fossil assemblage exhibit unimodal response functions of the environmental variable of interest. In contrast, machine-learning approaches do not rely upon any biological assumptions but instead need training with large data sets to extract some understanding of the relationships between biological assemblages and their environment. To explore the relative merits of these two approaches, we have developed a two-layered machine-learning reconstruction model MEMLM (Multi Ensemble Machine Learning Model). The first layer applies three different ensemble machine-learning models (random forests, extra random trees, and LightGBM), trained on the modern taxon assemblage and associated environmental data to make reconstructions based on the three different models, while the second layer uses multiple linear regression to integrate these three reconstructions into a consensus reconstruction. We considered three versions of the model: (1) a standard version of MEMLM, which uses only taxon abundance data; (2) MEMLMe, which uses only dimensionally reduced assemblage information, using a natural language-processing model (GloVe), to detect associations between taxa across the training data set; and (3) MEMLMc which incorporates both raw taxon abundance and dimensionally reduced summary (GloVe) data. We trained these MEMLM model variants with three high-quality diatom and pollen training sets and compared their reconstruction performance with three weighted-averaging (WA) approaches (WA-Cla for classical deshrinking, WA-Inv for inverse deshrinking, and WA-PLS for partial least squares). In general, the MEMLM approaches, even when trained on only dimensionally reduced assemblage data, performed substantially better than the WA approaches in the larger training sets, as judged by cross-validatory prediction error. When applied to fossil data, MEMLM variants sometimes generated qualitatively different palaeoenvironmental reconstructions from each other and from reconstructions based on WA approaches. We applied a statistical significance test to all the reconstructions. This successfully identified each incidence for which the reconstruction is not robust with respect to the model choice. We found that machine-learning approaches could outperform classical approaches but could sometimes fail badly in the reconstruction, despite showing high performance under cross-validation, likely indicating problems when extrapolation occurs. We found that the classical approaches are generally more robust, although they could also generate reconstructions which have modest statistical significance and therefore may be unreliable. Given these conclusions, we consider that cross-validation is not a sufficient measure of transfer function performance, and we recommend that the results of statistical significance tests are provided alongside the downcore reconstructions based on fossil assemblages.

An Improved Bayesian Semiparametric Model for Palaeoclimate Reconstruction: Cross-validation Based Model Assessment

On Bayesian Modelling of the Uncertainties in Palaeoclimate Reconstruction

A Fully Bayesian Approach to Assessment of Model Adequacy in Inverse Problems

Bayesian reconstruction of past land-cover from pollen data: model robustness and sensitivity to auxiliary variables

Can machine-learning algorithms improve upon classical palaeoenvironmental reconstruction models?

A Bayesian spatiotemporal model for reconstructing climate from multiple pollen records

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

A Methodology for Robust Multiproxy Paleoclimate Reconstructions and Modeling of Temperature Conditional Quantiles

Application of Bayesian Model Averaging in the Reconstruction of Past Climate Change Using PMIP3/CMIP5 Multimodel Ensemble Simulations

Bayesian Model Selection for a Class of Spatially-Explicit Capture Recapture Models

A Bayesian Hierarchical Time Series Model for Reconstructing Hydroclimate from Multiple Proxies

Bayesian cross-validation of geostatistical models

Infinite Mixture Models for Improved Modeling of Across-Site Evolutionary Variation

Quantifying Age and Model Uncertainties in Paleoclimate Data and Dynamical Climate Models with a Joint Inferential Analysis

Bayesian Approaches to Proxy Uncertainty Quantification in Paleoecology: A Mathematical Justification and Practical Integration

Bayesian Modeling of Incompatible Spatial Data: A Case Study Involving Post-Adrian Storm Forest Damage Assessment

Assessing the Adequacy of Morphological Models using Posterior Predictive Simulations

Efficient Selection Between Hierarchical Cognitive Models: Cross-validation With Variational Bayes

Modelling Spatial Compositional Data: Reconstructions of past land cover and uncertainties

Evaluating species distribution model predictions through time against paleozoological records

Bayesian inference of mixed Gaussian phylogenetic models