Abstract:Introduction: Assessment of surgical resident technical performance is an integral component of any surgical training program. Timely assessment delivered in a structured format is a critical step to enhance technical skills, but residents often report that the quality and quantity of timely feedback received is lacking. Moreover, the absence of written feedback with specificity can allow residents to seemingly progress in their operative milestones as a junior resident, but struggle as they progress into their postgraduate year 3 and above. We therefore designed and implemented a web-based intraoperative assessment tool and corresponding summary "dashboard" to facilitate real-time assessment and documentation of technical performance. Materials and methods: A web form was designed leveraging a cloud computing platform and implementing a modified Ottawa Surgical Competency Operating Room Evaluation instrument; this included additional, procedure-specific criteria for select operations. A link to this was provided to residents via email and to all surgical faculty as a Quick Response code. Residents open and complete a portion of the form on a smartphone, then relinquish the device to an attending surgeon who then completes and submits the assessment. The data are then transferred to a secure web-based reporting interface; each resident (together with a faculty advisor) can then access and review all completed assessments. Results: The Assessment form was activated in June 2021 and formally introduced to all residents in July 2021, with residents required to complete at least one assessment per month. Residents with less predictable access to operative procedures (night float or Intensive Care Unit) were exempted from the requirement on those months. To date a total of 559 assessments have been completed for operations performed by 56 trainees, supervised by 122 surgical faculty and senior trainees. The mean number of procedures assessed per resident was 10.0 and the mean number per assessor was 4.6. Resident initiation of Intraoperative Assessments has increased since the tool was introduced and scores for technical and nontechnical performance reliably differentiate residents by seniority. Conclusions: This novel system demonstrates that an online, resident-initiated technical assessment tool is feasible to implement and scale. This model's requirement that the attending enter performance ratings into the trainee's electronic device ensures that feedback is delivered directly to the trainee. Whether this aspect of our assessment ensures more direct and specific (and therefore potentially actionable) feedback is a focus for future study. Our use of commercial cloud computing services should permit cost-effective adoption of similar systems at other training programs.

Continuous training based on the needs of operating room nurses using web application: a new approach to improve their knowledge

The effect of educational application in nursing internship clinical training on cognitive and functional skills and students’ satisfaction

Development and evaluation of an anesthesia module for electronic medical records in the operating room: an applied developmental study

Roles of Two Learning Methods in the Perceived Competence of Surgery and Quality of Teaching: A Quasi-experimental Study among Operating Room Nursing Students

Education promotion based on “mobile technology” in the Critical Care Nursing Department: Four-phase intervention

Advancement in knowledge and skills of nursing students in operation theatre procedures with mobile based learning

Comparison of the effects of apprenticeship training by sandwich feedback and traditional methods on final-semester operating room technology students' perioperative competence and performance: a randomized, controlled trial

A new practical approach using TeamSTEPPS strategies and tools: – an educational design

The development and application of a phased 360-degree performance appraisal feedback system for operating room nurses

Application of Computer Multimedia Technology in Training and Teaching of Nursing Staff in Operating Room

The Effects of an E-learning Module on Medical Trainees Rotating on a Perioperative Medicine Clinical Service

Implementation of an Online Intraoperative Assessment of Technical Performance for Surgical Trainees

Comparing the impact of different transfusion medicine teaching methods—A mobile application versus task-based learning—On two dimensions of clinical competence among nursing students: A quasi-experimental study

Survey and Analysis of Continuing Education among Operating Room Nurses

Non-technical skills training to enhance performance of obstetrics and gynaecology residents in the operating room

Effects of technology-based educational tools on nursing learning outcomes in intensive care units: a systematic review and meta-analysis

Improvement of the First Training for Baccalaureate Nursing Students –A Mutual Approach

Design and Effect of Neurosurgical Educational Software Using Gamification on Students' Learning and Motivation

Continuing nursing education: use of observational pain assessment tool for diagnosis and management of pain in critically ill patients following training through a social networking app versus lectures

Improving the quality of clinical training in maternal and neonatal health in undergraduate nursing students: a participatory action research

Impact of blended teaching on academic achievement and well-being in operating room students: a semi-experimental study