From Paper to Platform: Evolution of a Novel Learning Environment for Tabletop Exercises

Valdemar Švábenský,Jan Vykopal,Martin Horák,Martin Hofbauer,Pavel Čeleda

DOI: https://doi.org/10.1145/3649217.3653639

2024-04-17

Abstract:For undergraduate students of computing, learning to solve complex practical problems in a team is an essential skill for their future careers. This skill is needed in various fields, such as in cybersecurity and IT governance. Tabletop exercises are an innovative teaching method used in practice for training teams in incident response and evaluation of contingency plans. However, tabletop exercises are not yet widely established in university education. This paper presents data and teaching experience from a cybersecurity course that introduces tabletop exercises in classrooms using a novel technology: INJECT Exercise Platform (IXP), a web-based learning environment for delivering and evaluating the exercises. This technology substantially improves the prior practice, since tabletop exercises worldwide have usually been conducted using pen and paper. Unlike in traditional tabletop exercises, which are difficult to evaluate manually, IXP provides insights into students' behavior and learning based on automated analysis of interaction data. We demonstrate IXP's capabilities and evolution by comparing exercise sessions hosted throughout three years at different stages of the platform's readiness. The analysis of student data is supplemented by the discussion of the lessons learned from employing IXP in computing education contexts. The data analytics enabled a detailed comparison of the teams' performance and behavior. Instructors who consider innovating their classes with tabletop exercises may use IXP and benefit from the insights in this paper.

Computers and Society,Cryptography and Security

What problem does this paper attempt to address?

This paper focuses on transforming the traditional paper-based tabletop exercises (TTX) into an innovative online learning environment called the INJECT Exercise Platform (IXP). TTX is an educational method used for team training in crisis response, particularly applicable to cybersecurity and IT governance courses. However, traditional TTX is usually conducted using pen and paper, which is time-consuming and inefficient in the evaluation process.

The paper proposes IXP as a web-based learning environment that automates the management and evaluation of TTX, providing in-depth analysis of student behavior and learning. By collecting interactive data, IXP enables detailed comparisons of team performance and offers teaching feedback to instructors. The authors demonstrate the development and effectiveness of the platform through three TTX course practices using IXP at different stages. They also analyze student data to understand how the platform enhances the teaching experience and learning outcomes.

The main objective of the research is to explore how IXP provides insights into student behavior and learning for instructors and the teaching experience in different versions of the learning environment for TTX. Furthermore, the paper discusses the lessons learned in using IXP in computer education, emphasizing the platform's capabilities in automated assessment and learning analytics.

In conclusion, this paper addresses the question of how to improve the TTX teaching method and enhance the effectiveness of teamwork and cybersecurity education through the utilization of new technologies.