Addressing equifinality in agent-based modeling: a sequential parameter space search method based on sensitivity analysis
Moongi Choi,Andrew Crooks,Neng Wan,Simon Brewer,Thomas J. Cova,Alexander Hohl,Moongi ChoiAndrew CrooksNeng WanSimon BrewerThomas J. CovaAlexander Hohla Department of Geography,The University of Utah,Salt Lake City,UT,USAb Department of Geography,University at Buffalo,Buffalo,NY,USAMoongi Choi is a Ph.D. candidate in the Department of Geography at the University of Utah. His research interests include geo-AI,encompassing agent-based modeling and machine learning,within the realm of health geography. He contributed to conceptualization,methodology,software development,validation,formal analysis,data curation,writing,reviewing,editing and visualization.Andrew Crooks is a professor of geography in the Department of Geography at the University of Buffalo. His research interests relate to exploring,understanding and the communication of physical and socio-economic environment using GIS,spatial analysis,geovisualization,agent-based modeling and social network analysis. He contributed to the content and technical review,review and editing.Neng Wan is an associate professor of geography and director of the Utah Geo-Health Lab at the University of Utah. He is interested in using GIS and spatial methods to understand and solve a variety of public health problems. He contributed to data curation,content and technical review.Simon Brewer is an associate professor in the Department of Geography at the University of Utah. His research focuses on understanding complex systems across space and time,utilizing knowledge of artificial intelligence and machine learning. He contributed to the content and technical review.Thomas J. Cova is a professor in the Department of Geography at the University of Utah. His research interests include environmental hazards,emergency management,transportation and geographic information science. He contributed to the manuscript and content review.Alexander Hohl is an assistant professor at the Department of Geography at the University of Utah. He is interested in statistical and machine learning methods with applications to health and wellbeing. He contributed to supervision,investigation,manuscript and editorial review and project administration.
DOI: https://doi.org/10.1080/13658816.2024.2331536
2024-04-02
International Journal of Geographical Information Science
Abstract:This study addresses the challenge of equifinality in agent-based modeling (ABM) by introducing a novel sequential calibration approach. Equifinality arises when multiple models equally fit observed data, risking the selection of an inaccurate model. In the context of ABM, such a situation might arise due to limitations in data, such as aggregating observations into coarse spatial units. It can lead to situations where successfully calibrated model parameters may still result in reliability issues due to uncertainties in accurately calibrating the inner mechanisms. To tackle this, we propose a method that sequentially calibrates model parameters using diverse outcomes from multiple datasets. The method aims to identify optimal parameter combinations while mitigating computational intensity. We validate our approach through indoor pedestrian movement simulation, utilizing three distinct outcomes: (1) the count of grid cells crossed by individuals, (2) the number of people in each grid cell over time (fine grid) and (3) the number of people in each grid cell over time (coarse grid). As a result, the optimal calibrated parameter combinations were selected based on high test accuracy to avoid overfitting. This method addresses equifinality while reducing computational intensity of parameter calibration for spatially explicit models, as well as ABM in general.
geography, physical,computer science, information systems,information science & library science