The CATS Hackathon: Creating and Refining Test Items for Cybersecurity Concept Inventories
Alan T. Sherman,Linda Oliva,Enis Golaszewski,Dhananjay Phatak,Travis Scheponik,Geoffrey L. Herman,Dong San Choi,Spencer E. Offenberger,Peter Peterson,Josiah Dykstra,Gregory V. Bard,Ankur Chattopadhyay,Filipo Sharevski,Rakesh Verma,Ryan Vrecenar
DOI: https://doi.org/10.1109/msec.2019.2929812
2019-11-01
Abstract:Presently, there is no rigorous, research-based method for measuring the quality of cybersecurity instruction. Validated assessment tools are needed so that cybersecurity educators have trusted methods for discerning whether efforts to improve student preparation are successful. The Cybersecurity Assessment Tools (CATS) Project<sup>9</sup> provides rigorous evidence-based instruments for assessing and evaluating educational practices (<uri>http://www.cisa.umbc.edu/cats/index.html</uri>). The first instrument is the Cybersecurity Concept Inventory (CCI), which measures how well students understand core concepts in cybersecurity (especially adversarial thinking) after a first course in the field. The second instrument, the Cybersecurity Curriculum Assessment (CCA), measures how well students understand the same core concepts after completing a full cybersecurity curriculum and whether they are ready to enter the workforce as cybersecurity professionals. These tools can identify pedagogies and content that are effective in teaching cybersecurity.
computer science, information systems, software engineering