Abstract:Introduction: The condition of trauma patients and the urgent need for timely resuscitation present unique challenges to trauma teams. These difficulties are exacerbated for military trauma teams in combat environments. Consequently, there is a need for continued improvement of nontechnical skills (NTS) training for trauma teams. However, current approaches to NTS assessment rely on subjective ratings, which can introduce bias. Accordingly, objective methods of NTS evaluation are needed. Eye-tracking (ET) methods have been applied to studying communication, situation awareness, and leadership in many health care settings, and could be applied to studying physicians' NTS during trauma situations. In this study, we aimed to assess the relationship between trauma team leaders' objective gaze patterns and subjective expert NTS ratings during patient care simulations. Materials and methods: After Institutional Review Board approval, 9 trauma teams from first-year post-graduate general surgery and emergency medicine residents were recruited to participate in 1 of 2 trauma simulations (a difficult airway case and a multi-patient trauma). Each scenario lasted approximately 15 minutes. All team leaders wore a mobile ET system to evaluate gaze metrics-time to first fixation (TTFF), average fixation duration (AFD), and total percentage of the scenario (TPS) focused on Areas of Interest (AOI), which included patient, care team, diagnostic equipment, and patient care equipment. Trained faculty raters completed the Non-Technical Skills for Surgeons (NOTSS) assessment tool and the Trauma Non-Technical Skills (T-NOTECHS) scale. One-way analysis of variance, Kruskal-Wallis, and appropriate post-hoc pairwise comparison tests were run to assess differences between ET metrics across AOI groups. Spearman's Rho tests were used to assess correlations between ET and subjective NTS ratings. Results: Compared to other NTS domains, trauma teams scored relatively poorly on communication across both T-NOTECHS (3.29$ \pm $0.61, maximum = 5) and NOTSS (2.87$ \pm $0.66, maximum = 4). We found significant differences in trauma team leaders' TTFF between teammates and the patient (Team: 1.56 vs Patient: 29.82 seconds, P < .001). TTFF on the diagnostic equipment was negatively correlated (P < .05) to multiple measures of subjective NTS assessments. There were no significant differences in AFD between AOIs, and AFD on teammates was positively correlated (P < .05) to communication and teamwork. There were significant differences in TPS across most AOI pairs (P < .05), and the average TPS fixated was highest on the patient (32%). Finally, there were several significant correlations between additional ET and NTS metrics. Conclusions: This study utilized a mixed methods approach to assess trauma team leaders' NTS in simulated acute care trauma simulations. Our results provide several objective insights into trauma team leaders' NTS behaviors during patient care simulations. Such objective insights provide a more comprehensive understanding of NTS behaviors and can be leveraged to guide NTS training of trauma physicians in the future. More studies are needed to apply these methods to capture NTS from a larger sample of teams in both simulated and real trauma environments.

Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills

The NOTECHS+: A Short Scale Designed for Assessing the Non-technical Skills (and more) in the Aviation and the Emergency Personnel

Further development of crew resource management training

RAS-NOTECHS: validity and reliability of a tool for measuring non-technical skills in robotic-assisted surgery settings

The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre

Crew resource management training in healthcare: a systematic review of intervention design, training conditions and evaluation

Development of a novel global rating scale for objective structured assessment of technical skills in an emergency medical simulation training

Cooperation objective evaluation in aviation: validation and comparison of two novel approaches in simulated environment

Development and validation of a tool for non-technical skills evaluation in robotic surgery-the ICARS system

Progressing Toward Airliners’ Reduced-Crew Operations: A Systematic Literature Review

Approach to Aircraft Handling Qualities Prediction

Instruments to evaluate non-technical skills during high fidelity simulation: A systematic review

Examining non-technical skills for ad hoc resuscitation teams: a scoping review and taxonomy of team-related concepts

Simulation-based medical education for Ambulance Jet and Helicopter Emergency Medical Services: A program description and evaluation

Assessment of Anaesthesia Teams' Non-Technical Skills in Clinical Practice before and after Simulation-Based Team Training: A Quasiexperimental Study

Improving pilots' tactical decisions in air combat training using the critical decision method

Review article: Use of the Team Emergency Assessment Measure in the rating of emergency teams' non‐technical skills: A mapping review

An exploratory study about the Challenges with Pilot Training and Recruitment in Europe

A Pilot Study of the Creation and Implementation of a Teaching Development Assessment Tool

The effects of crew resource management on flight safety culture: corporate crew resource management (CRM 7.0)

Nontechnical Skills Assessment in Acute Care Trauma Simulations: A Mixed Methods Approach Using Eye Tracking and Behavioral Marker Systems