Abstract:Classical palaeoenvironmental reconstruction models often incorporate biological ideas and commonly assume that the taxa comprising a fossil assemblage exhibit unimodal response functions of the environmental variable of interest. In contrast, machine-learning approaches do not rely upon any biological assumptions but instead need training with large data sets to extract some understanding of the relationships between biological assemblages and their environment. To explore the relative merits of these two approaches, we have developed a two-layered machine-learning reconstruction model MEMLM (Multi Ensemble Machine Learning Model). The first layer applies three different ensemble machine-learning models (random forests, extra random trees, and LightGBM), trained on the modern taxon assemblage and associated environmental data to make reconstructions based on the three different models, while the second layer uses multiple linear regression to integrate these three reconstructions into a consensus reconstruction. We considered three versions of the model: (1) a standard version of MEMLM, which uses only taxon abundance data; (2) MEMLMe, which uses only dimensionally reduced assemblage information, using a natural language-processing model (GloVe), to detect associations between taxa across the training data set; and (3) MEMLMc which incorporates both raw taxon abundance and dimensionally reduced summary (GloVe) data. We trained these MEMLM model variants with three high-quality diatom and pollen training sets and compared their reconstruction performance with three weighted-averaging (WA) approaches (WA-Cla for classical deshrinking, WA-Inv for inverse deshrinking, and WA-PLS for partial least squares). In general, the MEMLM approaches, even when trained on only dimensionally reduced assemblage data, performed substantially better than the WA approaches in the larger training sets, as judged by cross-validatory prediction error. When applied to fossil data, MEMLM variants sometimes generated qualitatively different palaeoenvironmental reconstructions from each other and from reconstructions based on WA approaches. We applied a statistical significance test to all the reconstructions. This successfully identified each incidence for which the reconstruction is not robust with respect to the model choice. We found that machine-learning approaches could outperform classical approaches but could sometimes fail badly in the reconstruction, despite showing high performance under cross-validation, likely indicating problems when extrapolation occurs. We found that the classical approaches are generally more robust, although they could also generate reconstructions which have modest statistical significance and therefore may be unreliable. Given these conclusions, we consider that cross-validation is not a sufficient measure of transfer function performance, and we recommend that the results of statistical significance tests are provided alongside the downcore reconstructions based on fossil assemblages.

Identifying Narrative Descriptions in Agent-Based Models Representing Past Human-Environment Interactions

Experimental Simulation: Using Generative Modeling and Palaeoecological Data to Understand Human-Environment Interactions

Situated Language Learning via Interactive Narratives

Evolutionary model discovery of causal factors behind the socio-agricultural behavior of the Ancestral Pueblo

GIS and Machine Learning Models Target Dynamic Settlement Patterns and Their Driving Mechanisms from the Neolithic to Bronze Age in the Northeastern Tibetan Plateau

Methods for Exploring Simulation Models

Modeling post-Pleistocene megafauna extinctions as complex social-ecological systems

Outreach in Archaeology with Agent-Based Modeling: Part 3 of 3

Studying Narrative Economics by Adding Continuous-Time Opinion Dynamics to an Agent-Based Model of Co-Evolutionary Adaptive Financial Markets

Geospatial Narratives and their Spatio-Temporal Dynamics: Commonsense Reasoning for High-level Analyses in Geographic Information Systems

To Plan or Not to Plan: Lessons Learned from Building Large Scale Social Simulations

Integrating Point Process Models, Evolutionary Ecology and Traditional Knowledge Improves Landscape Archaeology—A Case from Southwest Madagascar

Computational Social Science: Agent-based social simulation

Can machine-learning algorithms improve upon classical palaeoenvironmental reconstruction models?

Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizations

An artificial intelligence modelling approach to simulating animal/habitat interactions

Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering

Teaching the Modeling of Human-Environment Systems: Acknowledging Complexity with an Agent-Based Model

"where is this relationship going?": Understanding Relationship Trajectories in Narrative Text

An alternative use of the NetLogo modeling environment, where the student thinks and acts like an Agent, in order to teach concepts of Ecology

"What's my model inside of?": Exploring the role of environments for grounded natural language understanding