Abstract:Objective There are few assessments of the competence and growth of surgical residents as educators. We developed and piloted an observation-based feedback tool (FT) to provide residents direct feedback during a specific teaching session, as perceived by medical students (MS). We hypothesized that residents' performance would improve with frequent, low stakes, observation-based feedback. Setting This prospective study took place at an academic general surgery program. Participants Focus groups of MS, surgical residents, and faculty informed FT development. MS completed the FT regarding resident teaching. Design The FT utilized 5 slider-bar ratings (0 to 100) about the teaching encounter and a checklist of 16 desirable teaching behaviors. QR codes and weekly email links were distributed for 12 months (6 clerkship blocks) to promote use. Residents were sent their results after each block. A survey after each block assessed motivation for use and gathered feedback on the FT. Descriptive statistics were used for analysis (medians, IQRs). Primary measures of performance were median of the slider-bar scores and the number of teaching behaviors. Results The FT was used 111 times; 37 of 46 residents were rated by up to 65 MS. The median rating on the slider-bars was 100 and the median number of desirable teaching behaviors was 12; there were no differences based on gender or PGY level. 10 residents had 5 or more FT observations during the year. Four residents had evaluations completed in 4 or more blocks and 19 residents had evaluations completed in at least 2 blocks. Over time, 13 residents had consistent slider-bar scores, 1 resident had higher scores, and 5 residents had lower scores (defined as a more than 5-point change from initial rating). Frequency of use of the FT decreased over time (38, 32, 9, 21, 7, 5 uses per block). The post-use survey was completed by 24 MS and 19 residents. Most common reasons for usage were interest in improving surgical learning environment, giving positive feedback (MS), and improving teaching skills (residents). Most common reasons for lack of usage from residents were "I did not think I taught enough to ask for feedback," "I forgot it existed," and "I did not know it existed." Conclusions The FT did not lead to any meaningful improvement in resident scores over the course of the year. This may be due to overall high scores, suggesting that the components of the FT may require reevaluation. Additionally, decreased utilization of the instrument over time made it challenging to assess change in performance of specific residents, likely due to lack of awareness of the FT despite frequent reminders. Successful implementation of observation-based teaching assessments may require better integration with residency or clerkship objectives.

Teaching on the Fly: A Needs Assessment for an Ambulatory Resident-as-Teacher Workshop

Outpatient Teaching and Feedback Skills Workshop for Resident Physicians

The Effect of a 13-Hour Curriculum To Improve Residents' Teaching Skills

The resident-as-teacher educational challenge: a needs assessment survey at the National Autonomous University of Mexico Faculty of Medicine

Medical students as learners: transforming the resident-level microskills of teaching into a parallel curriculum for medical students to aid the transition from classroom to OB/GYN clerkship

A novel resident-as-teacher training program to improve and evaluate obstetrics and gynecology resident teaching skills

Creation and Implementation of an Online Tool for Feedback on Resident Teaching: A Pilot Study

An Interactive, Case-Based Workshop on the Patient Experience for Internal Medicine Residents

Impact of a Resident-as-Teacher Workshop on Teaching Behavior of Interns and Learning Outcomes of Medical Students.

Prior Teaching Experience and Barriers to Effective Resident Teaching: A Cross-Sectional Study

Developing internal medicine subspecialty fellows’ teaching skills: a needs assessment

Evaluation of a faculty development program aimed at increasing residents' active learning in lectures

Fellows as teachers: enhancing geriatrics fellows' teaching skills through direct observation and feedback

A Mini Chalk Talk Workshop for Fourth-Year Medical Students: Facilitating the Transition From Student to Resident Educator

Longitudinal resident coaching in the outpatient setting: A novel intervention to improve ambulatory consultation skills

Resident-as-Teacher: Can It Be Done With an E-Learning Module?

Using an ACTIVE teaching format versus a standard lecture format for increasing resident interaction and knowledge achievement during noon conference: a prospective, controlled study

Teaching Patient-Related Communication to Surgical Residents in Brief Training Sessions

Education Research: What Medical Students Value in Neurology Residents: A Qualitative Study to Inform Resident as Teacher Curricula

Teaching Skills Training for Pre-clinical Medical Students Through Weekly Problem-Based Learning Teaching Topic Presentations and Directed Feedback

Achieving the AAAs of Ambulatory Care: Aptitude, Appeal, and Appreciation