Abstract:[Context] In software engineering research, emphasis is given to sound evaluations of new approaches. While industry surveys or industrial case studies are preferred to evaluate industrial applicability, controlled experiments with student participants are commonly used to determine measurements such as effectiveness and efficiency of a proposed approach. [Objectives] In this paper, we elaborate on the current state of the art of controlled experiments using student participants. As student participants are commonly only reluctantly accepted in scientific communities and threats regarding the generalizability are quite obvious, we want to determine how widespread controlled experiments with student participants are and in which settings they are used. [Methods] This paper reports on a systematic mapping study using high-quality journals and conferences from the software engineering field as data sources. We scanned all papers published between 2010 and 2014 and investigated all papers reporting student experiments in detail. [Results] From 2788 papers under investigation 175 report results from controlled experiments. 109 (62.29%) of these controlled experiments have been conducted with student participants. Most experiments used undergraduate student participants, recruited students on a voluntary basis, and set them tasks to measure their comprehension. However, many experiments lack information regarding the students' recruitment and other important factors. [Conclusions] In conclusion, student participation in software engineering experiments can be seen as a common evaluation approach. In contrast, there seems to be little knowledge about the threats to validity in student experiments, as major drivers such as the recruitment are not reported at all.

When Students Choose to Use Event-B in their Software Engineering Projects

More Programming Than Programming: Teaching Formal Methods in a Software Engineering Programme

Applying a Formal Method in Industry: a 25-Year Trajectory

The Essence Theory of Software Engineering - Large-Scale Classroom Experiences from 450+ Software Engineering BSc Students

Using Students as Experimental Subjects in Software Engineering Research -- A Review and Discussion of the Evidence

Use and evaluation of simulation for software process education: a case study

Teaching Undergraduate Students to Think Like Real-World Systems Engineers: A Technology-Based Hybrid Learning Approach

Event-B at Work: Some Lessons Learnt from an Application to a Robot Anti-collision Function.

Assessment of a hybrid software development process for student projects: a controlled experiment

Gamifying the Escape from the Engineering Method Prison - An Innovative Board Game to Teach the Essence Theory to Future Project Managers and Software Engineers

Rooting Formal Methods within Higher Education Curricula for Computer Science and Software Engineering -- A White Paper

Controlled Experiments with Student Participants in Software Engineering: Preliminary Results from a Systematic Mapping Study

Integrating Software Engineering Key Practices into an OOP Massive In-Classroom Course: an Experience Report

Making Lab Sessions Mandatory -- On Student Work Distribution in a Gamified Project Course on Market-Driven Software Engineering

Formal Methods in Dependable Systems Engineering: A Survey of Professionals from Europe and North America

The Bourgeois Gentleman, Engineering and Formal Methods

Formal Methods: The Problem Is Education

Persona-based Assessment of Software Engineering Student Research Projects: An Experience Report

“FEApps”: Boosting students’ enthusiasm for coding and app designing, with a deeper learning experience in engineering fundamentals

A Case-Study on Teaching Undergraduate-Level Software Engineering Course Using Inverted-Classroom, Large-Group, Real-Client and Studio-Based Instruction Model

A Project-Based Learning Approach for Enhancing Learning Skills and Motivation in Software Engineering