Abstract:This conceptual replication study, building upon Bartholomew (2020), addresses a notable gap in the literature by investigating the potential of using learning by evaluating (LbE) as an interview primer for individual assignments in design coursework. While peer feedback commonly involves both giving and receiving feedback, LbE uniquely focuses on the benefits of giving feedback to engage students actively in learning, reflection, and critical thinking. In this study, the LbE process is utilized to foster student insights that may be transferred to their own work in the preparation and conducting of qualitative research interviews. Conducted as a quasi-experimental study in an entry-level design thinking course with a large sample of undergraduate students ( n = 325) this research explores specific ways that exposure to LbE as an evaluative process enhances students' abilities to perform qualitative research interviews, even without explicit teacher feedback. Findings, consistent with previous studies on LbE, indicate that students exposed to the intervention prepared a higher proportion of open-ended questions in their interview guides, demonstrating improved preparation for each interview. However, the transfer of preparation to performance revealed that certain skills such as asking probing questions and prompting for information, beyond the scope of the preparation of an interview guide, may have contributed to the observation that interview lengths did not significantly improve. Methodologically, this study employed random sampling, and a comparisons of treatment and control group interview guides and interview duration were conducted through independent samples t-tests. The significance of these findings suggest that LbE is an effective pedagogical strategy, specifically for individualized student work, expanding upon findings of previous studies. Educators and researchers may find this exploration of peer feedback through LbE on design thinking and qualitative research interviews to be of particular value as they seek to optimize the impact of peer feedback in enhancing student learning experiences.

Introduction to “Using Evaluation to Build Organizational Performance and Learning Capability: A Strategy and a Method”

Evaluation's role in enhancing organizational learning: A model for practice

Teaching program evaluation: How blending theory and practice enhance student-evaluator competencies in an education policy graduate program

Redesigning Computer-based Learning Environments: Evaluation as Communication

A Mixed Methods Evaluation of Teaching Evaluation: Innovative Course-Based Service-Learning Model on Program Evaluation Competencies

Delivery and evaluation of an e-Learning framework through computer-aided analysis of learners’ reflection text in a teacher development course

A holistic model for evaluating the impact of individual technology-enhanced learning resources

Developing a performance evaluation matrix to enhance the learner satisfaction of an e-learning system

Putting Program Theory into Operation

Teaching evaluation model design and data analysis based on the concept of "Postioning as the Core, Designing as the Soul" : —Take the science and engineering course "Signals and Systems" as an example

Evaluation framework for assessing network assisted courses based on learning management system

Evaluation of an Online Oral English Teaching Model Using Big Data

Evaluating technology-enhanced learning: A comprehensive framework

Vitalizing the evaluation of curricular implementation: a framework for attending to the "how and whys" of curriculum evolution

Creation and Evaluation of Software Teams - A Social Approach

Choosing and Evaluating Digital and Online Media: A Conceptual/Instructional Model

Gaining insight into interdisciplinary research and education programmes: A framework for evaluation

From knowledge and skills to digital works: An application of design thinking in the information technology course

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research

Learning by evaluating as an interview primer to inform design thinking

A case study approach for developing a project performance evaluation system