Abstract:Machine learning is increasingly used to study vegetation growth, however, more often than not, predicting and simulating functions are prioritized over quantitative estimates of the drivers of vegetation growth such as climate. In this paper, we, for the first time, systematically investigate the model bias in calculating factor importance of climate on vegetation growth, especially when various kinds of machine learning models are considered. We undertake two case studies to simulate research in remote sensing and ground-based scenarios from which the difference in quantitative relationships between climate and vegetation is evaluated across multiple models. We found that model complexity increased the determination coefficient (R 2 ) but reduced the absolute importance of the preselected independent variables. As the fitting accuracy increases, the absolute factor importance of dominant factor and all the other influencing factors decreases simultaneously, and factor importance calculated by different models tended to be more normally distributed across the study region. The reduction in factor importance was accompanied by the increased effect of model selection; e.g. the model that was used to estimate vegetation growth played a larger role in producing the factor importance (shown by variance analysis, remote sensing scenario, F-statistic = 555.2; ground based scenario, F-statistic = 30.8) than the climate variables (variance analysis, remote sensing scenario, F = 460.8; ground based scenario, F = 28.8). Critically, for those machine learning models with highest fitting accuracy, the resultant factor importance of climate factors had smaller difference with that of random factor. In contrast, the relative factor influence among the selected climate factor is more robust and reliable (in variation analysis, model was detected no significant impact on the resultant factor importance). For 5 of 8 models, the dominant factor (temperature) has relative influence over 0.85, ranging from 0.88 to 0.99. According to the relevant result, we suggest testing the stability of factor contribution in future studies, particularly when using machine learning models in ecological research and dealing with numerous factors, before drawing relative conclusions. The balance between simple and accurate models is contested and we believe that our study will contribute to a better understand of the data behind this debate.

Finding the appropriate level of complexity for a simulation model: An example with a forest growth model

How robust are Structural Equation Models to model miss-specification? A simulation study

The fraud loss for selecting the model complexity in fraud detection

Measuring complexity for hierarchical models using effective degrees of freedom

Competition for light in forest population dynamics: From computer simulator to mathematical model

Towards robust statistical inference for complex computer models

Use of a spatially explicit individual-tree model (SORTIE/BC) to explore the implications of patchiness in structurally complex forests

Unsuspected implications arising from assumptions in simulations: insights from recasting a forest growth model in system dynamics

The evolution, complexity and diversity of models of long‐term forest dynamics

Simulation of Larix gmelinii tree volume growth based on random effect

How Much Can We Gain with Increasing Model Complexity with the Same Model Concepts?

Does a large number of parameters enhance model performance? Comparative assessment of common catchment model structures on 429 catchments

Analyzing Decision-Making in Cognitive Agent Simulations Using Generalized Linear Mixed-Effects Models

The Effect of Model Misspecification on Growth Mixture Model Class Enumeration

Defining model complexity: An ecological perspective

SCALING FROM TREES TO FORESTS: TRACTABLE MACROSCOPIC EQUATIONS FOR FOREST DYNAMICS

Using multi-objective optimization to balance system-level model complexity

Simple or complex statistical models: Non-traditional regression models with intuitive interpretations

Model bias in calculating factor importance of climate on vegetation growth

A comparison between data requirements and availability for calibrating predictive ecological models for lowland UK woodlands: learning new tricks from old trees

A Bayesian approach to projecting forest dynamics and related uncertainty: An application to continuous cover forests