Moongi Choi,Andrew Crooks,Neng Wan,Simon Brewer,Thomas J. Cova,Alexander Hohl,Moongi ChoiAndrew CrooksNeng WanSimon BrewerThomas J. CovaAlexander Hohla Department of Geography,The University of Utah,Salt Lake City,UT,USAb Department of Geography,University at Buffalo,Buffalo,NY,USAMoongi Choi is a Ph.D. candidate in the Department of Geography at the University of Utah. His research interests include geo-AI,encompassing agent-based modeling and machine learning,within the realm of health geography. He contributed to conceptualization,methodology,software development,validation,formal analysis,data curation,writing,reviewing,editing and visualization.Andrew Crooks is a professor of geography in the Department of Geography at the University of Buffalo. His research interests relate to exploring,understanding and the communication of physical and socio-economic environment using GIS,spatial analysis,geovisualization,agent-based modeling and social network analysis. He contributed to the content and technical review,review and editing.Neng Wan is an associate professor of geography and director of the Utah Geo-Health Lab at the University of Utah. He is interested in using GIS and spatial methods to understand and solve a variety of public health problems. He contributed to data curation,content and technical review.Simon Brewer is an associate professor in the Department of Geography at the University of Utah. His research focuses on understanding complex systems across space and time,utilizing knowledge of artificial intelligence and machine learning. He contributed to the content and technical review.Thomas J. Cova is a professor in the Department of Geography at the University of Utah. His research interests include environmental hazards,emergency management,transportation and geographic information science. He contributed to the manuscript and content review.Alexander Hohl is an assistant professor at the Department of Geography at the University of Utah. He is interested in statistical and machine learning methods with applications to health and wellbeing. He contributed to supervision,investigation,manuscript and editorial review and project administration.

Abstract:This study addresses the challenge of equifinality in agent-based modeling (ABM) by introducing a novel sequential calibration approach. Equifinality arises when multiple models equally fit observed data, risking the selection of an inaccurate model. In the context of ABM, such a situation might arise due to limitations in data, such as aggregating observations into coarse spatial units. It can lead to situations where successfully calibrated model parameters may still result in reliability issues due to uncertainties in accurately calibrating the inner mechanisms. To tackle this, we propose a method that sequentially calibrates model parameters using diverse outcomes from multiple datasets. The method aims to identify optimal parameter combinations while mitigating computational intensity. We validate our approach through indoor pedestrian movement simulation, utilizing three distinct outcomes: (1) the count of grid cells crossed by individuals, (2) the number of people in each grid cell over time (fine grid) and (3) the number of people in each grid cell over time (coarse grid). As a result, the optimal calibrated parameter combinations were selected based on high test accuracy to avoid overfitting. This method addresses equifinality while reducing computational intensity of parameter calibration for spatially explicit models, as well as ABM in general.

Some challenges of calibrating differentiable agent-based models

Bayesian calibration of differentiable agent-based models

A Comparison of Economic Agent-Based Model Calibration Methods

Surrogate Assisted Methods for the Parameterisation of Agent-Based Models

Bridging the Micro and Macro: Calibration of Agent-Based Model Using Mean-Field Dynamics

Automatic Calibration of Dynamic and Heterogeneous Parameters in Agent-based Model

Calibration of stochastic, agent-based neuron growth models with Approximate Bayesian Computation

On learning agent-based models from data

Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning

Challenges in the calibration of large-scale ordinary differential equation models

Addressing equifinality in agent-based modeling: a sequential parameter space search method based on sensitivity analysis

Using machine learning as a surrogate model for agent-based simulations

Calibrating Neural Simulation-Based Inference with Differentiable Coverage Probability

A framework for the calibration of social simulation models

Automated and Distributed Statistical Analysis of Economic Agent-Based Models

Dealing with uncertainty in agent-based models for short-term predictions

The Problem of Calibrating an Agent-Based Model of High-Frequency Trading

Calibration of Derivative Pricing Models: a Multi-Agent Reinforcement Learning Perspective

Calibrating emergent phenomena in stock markets with agent based models

Everything you need to know about agent-based modelling and simulation