The 2023/24 VIEWS Prediction Challenge: Predicting the Number of Fatalities in Armed Conflict, with Uncertainty

Håvard Hegre,Paola Vesco,Michael Colaresi,Jonas Vestby,Alexa Timlick,Noorain Syed Kazmi,Friederike Becker,Marco Binetti,Tobias Bodentien,Tobias Bohne,Patrick T. Brandt,Thomas Chadefaux,Simon Drauz,Christoph Dworschak,Vito D'Orazio,Cornelius Fritz,Hannah Frank,Kristian Skrede Gleditsch,Sonja Häffner,Martin Hofer,Finn L. Klebe,Luca Macis,Alexandra Malaga,Marius Mehrl,Nils W. Metternich,Daniel Mittermaier,David Muchlinski,Hannes Mueller,Christian Oswald,Paola Pisano,David Randahl,Christopher Rauh,Lotta Rüter,Thomas Schincariol,Benjamin Seimon,Elena Siletti,Marco Tagliapietra,Chandler Thornhill,Johan Vegelius,Julian Walterskirchen

2024-07-08

Abstract:This draft article outlines a prediction challenge where the target is to forecast the number of fatalities in armed conflicts, in the form of the UCDP `best' estimates, aggregated to the VIEWS units of analysis. It presents the format of the contributions, the evaluation metric, and the procedures, and a brief summary of the contributions. The article serves a function analogous to a pre-analysis plan: a statement of the forecasting models made publicly available before the true future prediction window commences. More information on the challenge, and all data referred to in this document, can be found at <a class="link-external link-https" href="https://viewsforecasting.org/research/prediction-challenge-2023" rel="external noopener nofollow">this https URL</a>.

Applications,Machine Learning,Computation

What problem does this paper attempt to address?

The paper aims to address the issue of predicting casualties in armed conflicts, particularly how to make predictions in the form of probability distributions to better assess the uncertainty of the predictions. Specifically, the research objectives include:

1. **Predicting casualties in armed conflicts**: Using data from the Uppsala Conflict Data Program (UCDP), predict the number of casualties in armed conflicts across different geographic areas (national and sub-national levels).

2. **Estimating prediction uncertainty**: By providing samples of the predicted values, estimate the uncertainty of the prediction results, i.e., construct the predictive probability distribution of casualties.

3. **Conducting a prediction challenge**: Organized a prediction challenge, inviting different research teams to participate, aiming to compare the effectiveness of various prediction methods and promote research on modeling prediction uncertainty.

4. **Improving evaluation metrics**: Proposed a new set of evaluation metrics to assess the performance of prediction models, especially for the evaluation of probabilistic predictions.

Through this prediction challenge, researchers hope to make progress in the following areas:

- Improve the ability to predict the outbreak and escalation of conflicts.
- Develop better models to capture the uncertainty in the data generation process.
- Understand which model characteristics are most useful for improving probabilistic predictions.
- Explore evaluation methods that better reflect prediction uncertainty.