How to Evaluate Games in Education: A Literature Review

Giulio Barbero,Marcello M. Bonsangue,Felienne F. J. Hermans

DOI: https://doi.org/10.1007/978-981-99-5961-7_4

2024-07-04

Abstract:Adding game elements to higher education is an increasingly common practice. As a result, many recent empirical studies focus on studying the effectiveness of gamified or game-based educational experiences. The findings of these studies are very diverse, showing both positive and negative effects, and thus calling for comparative meta-studies. In this paper we review and analyze different studies, aiming to summarise and evaluate controlled experiments conducted within different scientific disciplines. We focus on the clarity of non-experimental conditions' descriptions and show that in most cases a. educational methods used in control groups' activities are poorly described, b. educational materials used in control groups' activities are often unclear, and c. the starting conditions are unclear. We also noticed that studies in the fields of computer science and engineering, in general, report results more clearly than in other fields. Based on the above finding, we conclude with a few recommendations for the execution of future empirical studies of games in education for the sake of allowing a more structured comparison.

Computers and Society,Computer Science and Game Theory

What problem does this paper attempt to address?

This paper aims to solve the problem of unclear description in educational game research, especially under the condition of controlled experiments. Specifically, the paper points out that in many empirical studies on the effectiveness of gamification or game - based learning experiences, the following problems exist:

1. **Insufficient description of educational methods used in control group activities**: Many studies fail to describe in detail the teaching methods of the control group, which makes it difficult to evaluate the differences between the experimental group and the control group.
2. **Unclear educational materials used in control group activities**: Similarly, many studies do not clearly state which teaching materials are used in the control group.
3. **Unclear starting conditions**: The starting conditions in the studies are often poorly described, which affects the comparability and repeatability of the research results.

These problems lead to the diversity and inconsistency of research results, thus requiring a comparative meta - analysis. By reviewing and analyzing different studies, the paper aims to summarize and evaluate the controlled experiments carried out in different disciplines and put forward suggestions for improving future empirical studies, so as to allow more structured comparisons.