Call for transparency of COVI D-19 models
C. Michael Barton,Marina Alberti,Daniel Ames,Jo-An Atkinson,Jerad Bales,Edmund Burke,Min Chen,Saikou Y. Diallo,David J. D. Earn,Brian Fath,Zhilan Feng,Christopher Gibbons,Ross Hammond,Jane Heffernan,Heather Houser,Peter S. Hovmand,Birgit Kopainsky,Patricia L. Mabry,Christina Mair,Petra Meier,Rebecca Niles,Brian Nosek,Nathaniel Osgood,Suzanne Pierce,J. Gareth Polhill,Lisa Prosser,Erin Robinson,Cynthia Rosenzweig,Shankar Sankaran,Kurt Stange,Gregory Tucker
DOI: https://doi.org/10.1126/science.abb8637
2020-01-01
Abstract:A hallmark of science is the open exchange of knowledge. At this time of crisis, it is more important than ever for scientists around the world to openly share their knowledge, expertise, tools, and technology. Scientific models are critical tools for anticipating, predicting, and responding to complex biological, social, and environmental crises, including pandemics. They are essential for guiding regional and national governments in designing health, social, and economic policies to manage the spread of disease and lessen its impacts. However, presenting modeling results alone is not enough. Scientists must also openly share their model code so that the results can be replicated and evaluated.
Given the necessity for rapid response to the coronavirus pandemic, we need many eyes to review and collectively vet model assumptions, parameterizations, and algorithms to ensure the most accurate modeling possible. Transparency engenders public trust and is the best defense against misunderstanding, misuse, and deliberate misinformation about models and their results. We need to engage as many experts as possible for improving the ability of models to represent epidemiological, social, and economic dynamics so that we can best respond to the crisis and plan effectively to mitigate its wider impacts.
We strongly urge all scientists modeling the coronavirus disease 2019 (COVID-19) pandemic and its consequences for health and society to rapidly and openly publish their code (along with specifying the type of data required, model parameterizations, and any available documentation) so that it is accessible to all scientists around the world. We offer sincere thanks to the many teams that are already sharing their models openly. Proprietary black boxes and code withheld for competitive motivations have no place in the global crisis we face today. As soon as possible, please place your code in a trusted digital repository ([ 1 ][1]) so that it is findable, accessible, interoperable, and reusable ([ 2 ][2]).
1. [↵][3]CoMSES Network, Trusted Digital Repositories ([www.comses.net/resources/trusted-digital-repositories/][4]). 2. [↵][5]1. M. D. Wilkinson et al ., Sci. Data 3, 160018 (2016). [OpenUrl][6]
Correction (1 May 2020): A second affiliation was added for J.-A.A., and the competing interests declarations were updated.
All authors have signed on behalf of the listed organizations only. E.B. advises but does not represent the UK Engineering and Physical Sciences Research Council (EPSRC). B.F. is affiliated with but does not represent the Advanced Systems Analysis Program at the International Institute for Applied Systems Analysis in Austria. P.L.M. is a paid consultant for Robert Wood Johnson Foundation Systems for Action (S4A), chair of the board of directors for Computer Simulation and Advanced Research Technologies, and an advisory board member of Systems Science in Public Health and Economics Research, but she does not represent these organizations. [1]: #ref-1 [2]: #ref-2 [3]: #xref-ref-1-1 View reference 1 in text [4]: http://www.comses.net/resources/trusted-digital-repositories/ [5]: #xref-ref-2-1 View reference 2 in text [6]: {openurl}?query=rft.jtitle%253DSci.%2BData%26rft.volume%253D3%26rft.spage%253D160018%26rft.genre%253Darticle%26rft_val_fmt%253Dinfo%253Aofi%252Ffmt%253Akev%253Amtx%253Ajournal%26ctx_ver%253DZ39.88-2004%26url_ver%253DZ39.88-2004%26url_ctx_fmt%253Dinfo%253Aofi%252Ffmt%253Akev%253Amtx%253Actx