Learning by evaluating as an interview primer to inform design thinking

Scott Thorne,Nathan Mentzer,Scott Bartholomew,Greg J. Strimel,Jason Ware
DOI: https://doi.org/10.1007/s10798-024-09933-2
2024-09-26
International Journal of Technology and Design Education
Abstract:This conceptual replication study, building upon Bartholomew (2020), addresses a notable gap in the literature by investigating the potential of using learning by evaluating (LbE) as an interview primer for individual assignments in design coursework. While peer feedback commonly involves both giving and receiving feedback, LbE uniquely focuses on the benefits of giving feedback to engage students actively in learning, reflection, and critical thinking. In this study, the LbE process is utilized to foster student insights that may be transferred to their own work in the preparation and conducting of qualitative research interviews. Conducted as a quasi-experimental study in an entry-level design thinking course with a large sample of undergraduate students ( n = 325) this research explores specific ways that exposure to LbE as an evaluative process enhances students' abilities to perform qualitative research interviews, even without explicit teacher feedback. Findings, consistent with previous studies on LbE, indicate that students exposed to the intervention prepared a higher proportion of open-ended questions in their interview guides, demonstrating improved preparation for each interview. However, the transfer of preparation to performance revealed that certain skills such as asking probing questions and prompting for information, beyond the scope of the preparation of an interview guide, may have contributed to the observation that interview lengths did not significantly improve. Methodologically, this study employed random sampling, and a comparisons of treatment and control group interview guides and interview duration were conducted through independent samples t-tests. The significance of these findings suggest that LbE is an effective pedagogical strategy, specifically for individualized student work, expanding upon findings of previous studies. Educators and researchers may find this exploration of peer feedback through LbE on design thinking and qualitative research interviews to be of particular value as they seek to optimize the impact of peer feedback in enhancing student learning experiences.
engineering, multidisciplinary,education & educational research,education, scientific disciplines
What problem does this paper attempt to address?