Abstract:National calls in science, technology, engineering, and technology education reform efforts have advanced the wide-scale engagement of students in undergraduate research for the preparation of a workforce and citizenry able to attend to the challenges of the 21st century. Awareness of the potential benefits and costs of these experiences has led to an emerging literature base outlining gains in participants’ cognitive, affective, and conative domains to support the impact of undergraduate research for students of all backgrounds; however, the majority of this work has relied on self-report data limiting inferences to the causal effects on student learning. As part of a larger project on apprentice-like undergraduate research experiences (UREs) in the physical sciences, the present exploratory study complemented indirect self-report data with direct performance data to assess the development of chemistry students’ scientific thinking skills over a research experience. Performance data were collected using the Performance assessment of Undergraduate Research Experiences (PURE) instrument, a validated tool designed to assess changes in chemistry students’ analytical and data driven decision-making skills through open-response tasks situated in real-world problems from primary literature. Twenty-four summer research students in chemistry (46% women; 50% 1st/2nd year students; 42% first time URE participant) from seven colleges and universities provided baseline and post-intervention performance data. Differences in pre/post-response task correctness provided a direct measure of individual changes in student competencies. Early study findings indicate the positive contributions of UREs to student's competencies in the areas of problem-solving, experimental design and the use of research techniques, data analysis and the interpretation of results, and the evaluation of primary literature. Survey data were also collected on students’ self-skill ratings to allow comparisons between perceived and demonstrated competencies, which were found to be weakly correlated. This work begins to offer direct evidence to the effect of UREs on student learning progressions as well as the potential use of performance test data in evaluating the success of research training interventions designed to improve scientific thinking skills.

Course-Based Undergraduate Research Experience: Music Education and Music Therapy Student Outcomes

Outcomes of a Course-based Undergraduate Research Experience (CURE) for Music Therapy and Music Education Students

Virtual Course-Based Undergraduate Research Experience (CURE) During the COVID-19 Pandemic

Engaging Undergraduate Students in Course-based Research Improved Student Learning of Course Material

Upper-level inter-disciplinary microbiology CUREs increase student's scientific self-efficacy, scientific identity, and self-assessed skills

Perceived Student Benefits of an Undergraduate Physiological Psychology Laboratory Course

Development and Evaluation of the Tigriopus Course-Based Undergraduate Research Experience: Impacts on Students’ Content Knowledge, Attitudes, and Motivation in a Majors Introductory Biology Course

An introductory biology research-rich laboratory course shows improvements in students' research skills, confidence, and attitudes

A Course-Based Undergraduate Research Experience Improves Outcomes in Mentored Research

Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology

Music Therapy as a Topic in Medical Education: Course Concept and Student Evaluation of an Elective Course for Medical Students

Characterization of Instructor and Student Behaviors in CURE and Non-CURE Learning Environments: Impacts on Student Motivation, Science Identity Development, and Perceptions of the Laboratory Experience

Using Case-Based Learning to Teach Information Literacy and Critical Thinking Skills in Undergraduate Music Therapy Education: A Cohort Study

Comparing the Impact of Course-Based and Apprentice-Based Research Experiences in a Life Science Laboratory Curriculum

Undergraduate research programs build skills for diverse students

Course Apprenticeship-Based Undergraduate Research and Its Impact on Student Degree Interest

Evaluating the development of chemistry undergraduate researchers’ scientific thinking skills using performance-data: first findings from the performance assessment of undergraduate research (PURE) instrument

Integration of RCR and Ethics Education into Course-Based Undergraduate Research Experiences in the Biological Sciences: A Needed Discussion

A Mixed-Methods Investigation of Preservice Music Teaching Efficacy Beliefs and Commitment to Music Teaching

Hard Work and Hopefulness: A Mixed Methods Study of Music Students’ Status and Beliefs in Relation to Health, Wellbeing, and Success as They Enter Specialized Higher Education

Self-reported mental health and mental illness among university music students in the United States