No model to rule them all: a systematic comparison of 83 thermal performance curve models across traits and taxonomic groups

Dimitrios - Georgios Kontopoulos,Arnaud Sentis,Martin Daufresne,Natalia Glazman,Anthony I. Dell,Samraat Pawar
DOI: https://doi.org/10.1101/2023.09.08.556856
2024-07-02
Abstract:In ectotherms, the performance of physiological, ecological, and life-history traits universally increases with temperature to a maximum before decreasing again. Identifying the most appropriate thermal performance model for a specific trait type has broad applications, from metabolic modelling at the cellular level to forecasting the effects of climate change on population, ecosystem, and disease transmission dynamics. To date, numerous mathematical models have been designed, but a thorough comparison among them is lacking. In particular, we do not know if certain models consistently outperform others and how factors such as sampling resolution and trait or organismal identity influence model performance. To fill this knowledge gap, we compile 2,739 thermal performance datasets from diverse traits and taxa, to which we fit a comprehensive set of 83 existing mathematical models. We detect remarkable variation in model performance that is not primarily driven by sampling resolution, trait type, or taxonomic information. Our results reveal a surprising lack of well-defined scenarios in which certain models are more appropriate than others. To aid researchers in selecting the appropriate set of models for any given dataset or research objective, we derive a classification of the 83 models based on the average similarity of their fits.
Ecology
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to determine which Thermal Performance Curve (TPC) model is the most appropriate among different biological traits and taxa. Specifically, the paper aims to: 1. **Are there certain models that can consistently outperform other models on any dataset?** - By systematically comparing 83 different TPC models, the paper explores the performance of different models on various datasets to determine whether there are certain models that can be generally applicable. 2. **As the sampling resolution of the dataset increases, can complex models with more parameters continuously outperform simple models?** - The researchers analyzed datasets with different resolutions (low - resolution, medium - resolution, high - resolution) to evaluate the relationship between model complexity and performance. 3. **For basic physiological traits, do mechanistic models (based on the principles of biochemical kinetics) perform better than phenomenological models (based on empirical data)?** - The paper divided the datasets into three categories: physiological traits, emergent traits, and inter - species interaction traits, and respectively evaluated the performance differences between mechanistic models and phenomenological models under different types of traits. ### Main Findings 1. **Variability in Model Performance**: - The performance of models strongly depends on the specific dataset, and no model can perform excellently on all datasets. Nevertheless, some models (such as the Gaussian model, the Simplified Briere I model, the quadratic polynomial model, the Mitchell - Angilletta model, the Eubank model) perform relatively well in multiple datasets. 2. **Comparison between Complex and Simple Models**: - Even in high - resolution datasets, most of the top - performing ten models are models with three to four parameters. Five of the best models in low -, medium -, and high - resolution datasets are the same three - parameter models, indicating that increasing model complexity does not necessarily significantly improve performance. 3. **Comparison between Mechanistic and Phenomenological Models**: - For physiological traits, none of the top - performing ten models is a mechanistic model. Whether it is physiological traits, emergent traits, or inter - species interaction traits, seven of the best - performing models are the same, but with different rankings. This indicates that even in the measurement of traits controlled by specific biochemical pathways, mechanistic models are not necessarily superior to simple phenomenological models. ### Conclusion The paper reveals that when choosing a TPC model, no model can be universally applicable to all situations. The research results emphasize that in practical applications, an appropriate model should be selected according to the specific dataset and research purpose. In addition, the selection of a model should not be based solely on its complexity or theoretical basis, but should comprehensively consider the actual fitting effect of the model.