Fiber optics communications. Edited by Henry f. Taylor.

J. Meyer–Arendt

IF: 1.9

1985-01-15

Applied Optics

Abstract:

What problem does this paper attempt to address?

Impact of an educational intervention on eye gaze behaviour in retinal image interpretation by consultant and trainee ophthalmologists

Kate Shirley,Michael Williams,Laura McLaughlin,Nicola Parker,Raymond Bond

DOI: https://doi.org/10.1177/1460458219881337

2019-10-19

Health Informatics Journal

Abstract:This study uses eye-tracking technology to assess the differences in gaze behaviours between ophthalmologists of different experience levels while interpreting retinal images of diabetic retinopathy. The differences in gaze behaviours before and after a teaching intervention which introduced a suggested search strategy is also investigated. A total of 9 trainees and 10 consultant ophthalmologists interpreted six retinal images. They were then shown a 5-min tutorial that demonstrated a search strategy. This was followed by six further retinal image interpretations. Participants completed questionnaires indicating clinical signs seen, appropriate retinopathy grade, and confidence. Eye movements were tracked during each interpretation.Overall, trainees compared to consultants demonstrated more uncertain and unstructured gaze behaviours. Trainee eye gaze metrics included: longer interpretation time, 36.5 s (SD = 6.2 vs. 31.4 s) (SD = 4.2) (p = 0.024), higher visit count, 17.38 visits (SD = 5.13) versus 12.18 visits(SD = 2.64) (p = 0.01), higher proportion of fixation, 57.0 per cent (SD = 5) versus 50.5 per cent (SD = 5) (p = 0.05) and shorter time to first fixation, 0.232 s (SD = 0.10) versus 0.821 s (SD = 0.77) (p = 0.001), respectively. The teaching intervention resulted in more focused gaze patterns in both groups. Pre-intervention and post-intervention mean proportion fixation on areas of interest were 38.6 per cent (SD = 6.8) and 51.8 per cent (SD = 13.9) for the trainee group, respectively, and 39.9 per cent (SD = 4.1) and 50.9 per cent (SD = 9.3) for the consultant group (p = 0.01).Consultants used more systematic and efficient approaches than trainees during interpretation. After the introduction of a suggested search strategy, trainees showed trends towards consultant eye gaze behaviours. Eye tracking gives an interesting insight into the thought processes of physicians carrying out complex tasks. The implication is that eye tracking may have future use in teaching and assessment. Its use in objectively assessing different teaching strategies could be a valuable tool for medical education.

health care sciences & services,medical informatics
Eye Gaze Perception and Gaze Cueing Effect

Zhijun Zhang

2007-01-01

Abstract:The studies on gaze perception,gaze cueing effect and its determinants were reviewed.It was suggested:(1)A strikingly strong sensitivity to eye gaze is observed from birth,and eye gaze perception is key to the development of language capabilities and social cognition;(2)The neural basis of gaze perception is the superior temporal sulcus(STS),which is heavily connected with the amygdala implicated in processing emotion,and the STS is an important part of a wider network for social cognition neural systems;(3)Processing on early stage of eyes gaze cueing reveals specific event-related potential(ERP)component;(4)The eyes gaze cueing effect has been labeled reflexive and likened to orienting in response to peripheral cues,however,it lasts longer;(5)The gaze cueing effect is influenced by many different facets,from lower level configural aspects such as face orientation to higher level cognitive factors.Furthermore,the gaze cueing effect reveals significant sex difference in normal adult population.It was finally believed that further research should concern with higher social cognitive interactions such as personality judgments,affective appraisal,and theory of mind.
Cheating experience: Guiding novices to adopt the gaze strategies of experts expedites the learning of technical laparoscopic skills

Samuel J. Vine,Rich S.W. Masters,John S. McGrath,Elizabeth Bright,Mark R. Wilson

DOI: https://doi.org/10.1016/j.surg.2012.02.002

IF: 4.348

2012-07-01

Surgery

Abstract:BACKGROUND: Previous research has demonstrated that trainees can be taught (via explicit verbal instruction) to adopt the gaze strategies of expert laparoscopic surgeons. The current study examined a software template designed to guide trainees to adopt expert gaze control strategies passively, without being provided with explicit instructions.METHODS: We examined 27 novices (who had no laparoscopic training) performing 50 learning trials of a laparoscopic training task in either a discovery-learning (DL) group or a gaze-training (GT) group while wearing an eye tracker to assess gaze control. The GT group performed trials using a surgery-training template (STT); software that is designed to guide expert-like gaze strategies by highlighting the key locations on the monitor screen. The DL group had a normal, unrestricted view of the scene on the monitor screen. Both groups then took part in a nondelayed retention test (to assess learning) and a stress test (under social evaluative threat) with a normal view of the scene.RESULTS: The STT was successful in guiding the GT group to adopt an expert-like gaze strategy (displaying more target-locking fixations). Adopting expert gaze strategies led to an improvement in performance for the GT group, which outperformed the DL group in both retention and stress tests (faster completion time and fewer errors).CONCLUSION: The STT is a practical and cost-effective training interface that automatically promotes an optimal gaze strategy. Trainees who are trained to adopt the efficient target-locking gaze strategy of experts gain a performance advantage over trainees left to discover their own strategies for task completion.

surgery
EYE-ECG: An RCT of the influence of student characteristics and expert eye-tracking videos with cued retrospective reporting on students' ECG interpretation skills

Aline D Scherff,Stefan Kääb,Martin R Fischer,Markus Berndt

DOI: https://doi.org/10.3205/zma001695

2024-09-16

Abstract:Objectives: Teaching of ECG interpretation frequently relies on visual schemas. However, subsequent student ECG interpretation skills are often poor. Expertise research shows that expert looking patterns frequently deviate from the steps taught in schema learning. The present study made a cardiology expert's gaze interpreting ECGs visible - through eye-tracking videos with cued retrospective reporting (CRR) - and investigated the potential as an additional expert-driven route to improve medical students' ECG interpretation skills. Methods: N=91 Medical students participated in the RCT of an ECG e-learning session aimed at medical students' ECG interpretation skills gain, either receiving the newly developed eye-tracking video with CRR audio commentary materials (n=47) or studying via four clinical cases only (n=44). Three outcome scores relating to different aspects of ECG interpretation skills were derived from pre-post MCQ ECG tests. The effect of the EYE-ECG training and additional characteristics (e.g., prior experience, interest) on student ECG interpretation skills were evaluated using t-tests and multivariate linear regression. Results: A small, non-significant advantage of the EYE-ECG training signifying a tendency for greater knowledge gain was observed, compared to training as usual. In multivariate regression models, the predictive value of clinical case 1 was an unexpected finding warranting further exploration. Conclusion: Additional gains after an only 9-minute intervention using videos of expert's real-time gaze pattern in combination with hearing their thought processes during ECG interpretation is a promising finding. Furthermore, a number of specific performance characteristics enabling students to best benefit from ECG training were identified and possible modifications to the learning intervention suggested.
Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: a randomized, controlled study

Mark R. Wilson,Samuel J. Vine,Elizabeth Bright,Rich S. W. Masters,David Defriend,John S. McGrath

DOI: https://doi.org/10.1007/s00464-011-1802-2

2011-06-14

Surgical Endoscopy

Abstract:BackgroundThe operating room environment is replete with stressors and distractions that increase the attention demands of what are already complex psychomotor procedures. Contemporary research in other fields (e.g., sport) has revealed that gaze training interventions may support the development of robust movement skills. This current study was designed to examine the utility of gaze training for technical laparoscopic skills and to test performance under multitasking conditions.MethodsThirty medical trainees with no laparoscopic experience were divided randomly into one of three treatment groups: gaze trained (GAZE), movement trained (MOVE), and discovery learning/control (DISCOVERY). Participants were fitted with a Mobile Eye gaze registration system, which measures eye-line of gaze at 25 Hz. Training consisted of ten repetitions of the “eye-hand coordination” task from the LAP Mentor VR laparoscopic surgical simulator while receiving instruction and video feedback (specific to each treatment condition). After training, all participants completed a control test (designed to assess learning) and a multitasking transfer test, in which they completed the procedure while performing a concurrent tone counting task.ResultsNot only did the GAZE group learn more quickly than the MOVE and DISCOVERY groups (faster completion times in the control test), but the performance difference was even more pronounced when multitasking. Differences in gaze control (target locking fixations), rather than tool movement measures (tool path length), underpinned this performance advantage for GAZE training.ConclusionsThese results suggest that although the GAZE intervention focused on training gaze behavior only, there were indirect benefits for movement behaviors and performance efficiency. Additionally, focusing on a single external target when learning, rather than on complex movement patterns, may have freed-up attentional resources that could be applied to concurrent cognitive tasks.

English Else
Gaze training improves the retention and transfer of laparoscopic technical skills in novices

Samuel J. Vine,Richard J. Chaytor,John S. McGrath,Rich S. W. Masters,Mark R. Wilson

DOI: https://doi.org/10.1007/s00464-013-2893-8

2013-03-12

Surgical Endoscopy

Abstract:BackgroundGaze training is an effective way of training basic laparoscopic skills, resulting in faster acquisition periods and more robust subsequent performance under pressure. The current study is a randomized control trial which examines whether the performance benefits of gaze training stand the test of time (delayed retention) and transfer to more complex skills.MethodsThirty-six medical students were trained to proficiency (50 trials) on a one-handed laparoscopic task (picking and dropping balls) in either a discovery learning (DL) or gaze training (GT) group. Both groups performed the one-handed task in baseline, retention and delayed retention (1 month) tests. They also performed baseline, retention and delayed retention tests of a two-handed task (grasping and cutting). Performance (completion time) and gaze control (target locking) were assessed throughout.ResultsFor the one-handed task, the GT group displayed superior performance at retention (p < .001), underpinned by more expert-like gaze control (p < .05). The GT group also displayed superior performance in the one-handed task at delayed retention (p < .005), underpinned by more expert-like gaze control strategies (p < .001). Although the DL group’s performance fell to 84 % of performance at retention, the GT group maintained performance at 100 % of retention. There were no differences between the groups for the two-handed task at retention (p = .140); however, at delayed retention, the GT group outperformed the DL group (p < .005) and displayed more expert-like gaze control (p < .001).ConclusionsNovices trained to adopt an expert-like gaze control strategy were able to attain higher levels of performance more quickly than novices who learned by discovery alone. Furthermore, these skills were more durable over time and were transferable to more complex skills. Gaze training is a beneficial intervention to aid the acquisition of the basic motor skills required for laparoscopy.

English Else
A new way to look at simulation-based assessment: the relationship between gaze-tracking and exam performance

Adam Szulewski,Rylan Egan,Andreas Gegenfurtner,Daniel Howes,Gerhard Dashi,Nick C J McGraw,Andrew K Hall,Damon Dagnone,Jeroen J G van Merrienboer

DOI: https://doi.org/10.1017/cem.2018.391

CJEM

Abstract:Objective: A key task of the team leader in a medical emergency is effective information gathering. Studying information gathering patterns is readily accomplished with the use of gaze-tracking glasses. This technology was used to generate hypotheses about the relationship between performance scores and expert-hypothesized visual areas of interest in residents across scenarios in simulated medical resuscitation examinations. Methods: Emergency medicine residents wore gaze-tracking glasses during two simulation-based examinations (n=29 and 13 respectively). Blinded experts assessed video-recorded performances using a simulation performance assessment tool that has validity evidence in this context. The relationships between gaze patterns and performance scores were analyzed and potential hypotheses generated. Four scenarios were assessed in this study: diabetic ketoacidosis, bradycardia secondary to beta-blocker overdose, ruptured abdominal aortic aneurysm and metabolic acidosis caused by antifreeze ingestion. Results: Specific gaze patterns were correlated with objective performance. High performers were more likely to fixate on task-relevant stimuli and appropriately ignore task-irrelevant stimuli compared with lower performers. For example, shorter latency to fixation on the vital signs in a case of diabetic ketoacidosis was positively correlated with performance (r=0.70, p<0.05). Conversely, total time spent fixating on lab values in a case of ruptured abdominal aortic aneurysm was negatively correlated with performance (r= −0.50, p<0.05). Conclusions: There are differences between the visual patterns of high and low-performing residents. These findings may allow for better characterization of expertise development in resuscitation medicine and provide a framework for future study of visual behaviours in resuscitation cases.
Medical imaging training with eye movement modeling examples: A randomized controlled study

Dogus Darici,Max Masthoff,Robert Rischen,Martina Schmitz,Hendrik Ohlenburg,Markus Missler

DOI: https://doi.org/10.1080/0142159X.2023.2189538

IF: 4.277

2023-03-23

Medical Teacher

Abstract:To determine whether ultrasound training in which the expert's eye movements are superimposed to the underlying ultrasound video (eye movement modeling examples; EMMEs) leads to better learner outcomes than traditional eye movement-free instructions. 106 undergraduate medical students were randomized in two groups; 51 students in the EMME group watched 5-min ultrasound examination videos combined with the eye movements of an expert performing the task. The identical videos without the eye movements were shown to 55 students in the control group. Performance and behavioral parameters were compared prepost interventional using ANOVAs. Additionally, cognitive load, and prior knowledge in anatomy were surveyed. After training, the EMME group identified more sonoanatomical structures correctly, and completed the tasks faster than the control group. This effect was partly mediated by a reduction of extraneous cognitive load. Participants with greater prior anatomical knowledge benefited the most from the EMME training. Displaying experts' eye movements in medical imaging training appears to be an effective way to foster medical interpretation skills of undergraduate medical students. One underlying mechanism might be that practicing with eye movements reduces cognitive load and helps learners activate their prior knowledge.

education, scientific disciplines,health care sciences & services
Developing expert gaze pattern in laparoscopic surgery requires more than behavioral training

Sicong Liu,Rachel Donaldson,Ashwin Subramaniam,Hannah Palmer,Cosette D Champion,Morgan L Cox,L Gregory Appelbaum,Cosette D. Champion,Morgan L. Cox,L. Gregory Appelbaum

DOI: https://doi.org/10.16910/jemr.14.2.2

IF: 1.3489

2021-03-10

Journal of Eye Movement Research

Abstract:Expertise in laparoscopic surgery is realized through both manual dexterity and efficient eye movement patterns, creating opportunities to use gaze information in the educational process. To better understand how expert gaze behaviors are acquired through deliberate practice of technical skills, three surgeons were assessed and five novices were trained and assessed in a 5-visit protocol on the Fundamentals of Laparoscopic Surgery peg transfer task. The task was adjusted to have a fixed action sequence to allow recordings of dwell durations based on pre-defined areas of interest (AOIs). Trained novices were shown to reach more than 98% (M = 98.62%, SD = 1.06%) of their behavioral learning plateaus, leading to equivalent behavioral performance to that of surgeons. Despite this equivalence in behavioral performance, surgeons continued to show significantly shorter dwell durations at visual targets of current actions and longer dwell durations at future steps in the action sequence than trained novices (ps ≤ .03, Cohen’s ds > 2). This study demonstrates that, while novices can train to match surgeons on behavioral performance, their gaze pattern is still less efficient than that of surgeons, motivating surgical training programs to involve eye tracking technology in their design and evaluation.

ophthalmology
[Traumatic dislocation of the hip with fracture of neck of femur].

R. Cattaneo

Abstract:
See Like an Expert: Gaze-Augmented Training Enhances Skill Acquisition in a Virtual Reality Robotic Suturing Task

Rachel Melnyk,Timothy Campbell,Tyler Holler,Katherine Cameron,Patrick Saba,Michael W. Witthaus,Jean Joseph,Ahmed Ghazi

DOI: https://doi.org/10.1089/end.2020.0445

2021-03-01

Journal of Endourology

Abstract:Introduction: The da Vinci skills simulator (DVSS) is an effective platform for robotic skills training. Novel training methods using expert gaze patterns to guide trainees have demonstrated superiority to traditional instruction. Portable head-mounted eye-trackers (HMET) offer the opportunity for eye tracking technology to enhance surgical robotic simulation training. Objective: To evaluate if training guided by expert gaze patterns can improve trainee performance over standard movement training techniques during robotic simulation. Methods: Medical students were recruited and randomized into gaze training (GT, n=9) and movement training (MT, n=8) groups. First, the participants reviewed an instructional video, GT group emulating expert gaze patterns and the MT group (n=8) standard movement-based instruction. Training consisted of ten repetitions of "Suture Sponge 3" on the DVSS while wearing HMET; the first three repetitions were followed by group-appropriate video coaching (gaze vs. movement feedback) while the remaining repetitions were without feedback. Finally, two multitasking repetitions with a secondary bell-counting task were completed. Primary outcomes included DVSS scores during training and multitasking. Secondary outcomes included metrics collected from the HMET (gaze patterns and gaze entropy). Results: Total score, efficiency, and penalties improved significantly over the training in both groups; the GT group achieved higher scores on every attempt. Total scores in the GT group were higher than the MT group post-video review (20.3±21.8 vs. 3.0±6.2, p=0.047), after coaching repetitions (61.8±18.8 vs 30.1±26.2, p=0.01), and at the last training attempt (73.0±16.5 vs. 63.1±17.4, p = 0.247). During multitasking, the GT group maintained higher total scores (75±10.1 vs. 63.3±15.3, p=0.01), efficiency (86.3±7.4 vs. 77.4±11.2, p=0.009), and superior secondary task performance (error: 6.3%±0.06 vs 10.7%±0.11, p=0.20). Gaze entropy (cognitive-load indicator) and gaze pattern analysis showed similar trends. Conclusion: Gaze-augmented training leads to more efficient movements through adoption of expert gaze patterns that withstand additional stressors.

urology & nephrology
Virtual pointer for gaze guidance in laparoscopic surgery

Yuanyuan Feng,Hannah McGowan,Azin Semsar,Hamid R. Zahiri,Ivan M. George,Adrian Park,Andrea Kleinsmith,Helena Mentis

DOI: https://doi.org/10.1007/s00464-019-07141-x

2019-10-04

Surgical Endoscopy

Abstract:<h3 class="Heading">Background</h3><p class="Para">A challenge of laparoscopic surgery is learning how to interpret the indirect view of the operative field. Acquiring professional vision—understanding what to see and which information to attend to, is thereby an essential part of laparoscopic training and one in which trainers exert great effort to convey. We designed a virtual pointer (VP) that enables experts to point or draw free-hand sketches over an intraoperative laparoscopic video for a novice to see. This study aimed to investigate the efficacy of the virtual pointer in guiding novices' gaze patterns.</p><h3 class="Heading">Methods</h3><p class="Para">We conducted a counter-balanced, within-subject trial to compare the novices' gaze behaviors in laparoscopic training with the virtual pointer compared to a standard training condition, i.e., verbal instruction with un-mediated gestures. In the study, seven trainees performed four simulated laparoscopic tasks guided by an experienced surgeon as the trainer. A Tobii Pro X3-120 eye-tracker was used to capture the trainees' eye movements. The measures include fixation rate, i.e., the frequency of trainees' fixations, saccade amplitude, and fixation concentration, i.e., the closeness of trainees' fixations.</p><h3 class="Heading">Results</h3><p class="Para">No significant difference in fixation rate or saccade amplitude was found between the virtual pointer condition and the standard condition. In the virtual pointer condition, trainees' fixations were more concentrated (<em class="EmphasisTypeItalic">p</em> = 0.039) and longer fixations were more clustered, compared to the Standard condition (<em class="EmphasisTypeItalic">p</em> = 0.008).</p><h3 class="Heading">Conclusions</h3><p class="Para">The virtual pointer effectively improved surgical trainees' in-the-moment gaze focus during the laparoscopic training by reducing their gaze dispersion and concentrating their attention on the anatomical target. These results suggest that technologies which support gaze training should be expert-driven and intraoperative to efficiently modify novices' gaze behaviors.</p>

English Else
A New Method to Evaluate Gaze Behavior Patterns in Doctor-Patient Interaction

Jie Xu,Onur Asan,Enid N. H. Montague

DOI: https://doi.org/10.1037/e578902012-100

2011-01-01

Proceedings of the Human Factors and Ergonomics Society Annual Meeting

Abstract:Eye gaze behavior is considered an important aspect of doctor-patient nonverbal interaction process in a clinical encounter. Previous research shows that eye gaze behavior patterns works as part of a doctor's communication style and affects certain medical outcomes. New interventions (behavioral and technological) are continuously being introduced to the clinical encounters due to health care work system redesign and there is a need to evaluate the impact of these interventions on communication. The aim of this study was to develop a systematic approach to evaluate eye gaze behavior patterns using video coding and lag sequential analysis technique. Thirty-two clinical encounters with two interaction styles were analyzed. Differences and similarities in eye gaze behavior pattern were found in the two styles. Implications for interventions and evaluation in doctor-patient interaction are discussed.
Learners Learn More and Instructors Track Better with Real-time Gaze Sharing

Gahyun Sung,Tianyi Feng,Bertrand Schneider

DOI: https://doi.org/10.1145/3449208

2021-04-13

Abstract:Shared gaze visualizations, where the real-time gaze location of group members is shared with one another, have become increasingly studied over the last decade by HCI researchers. Shared gaze studies so far have found improved outcomes and better collaboration for peer collaborators. Less is known, however, about how gaze sharing may aid learners and instructors. In our study, an instructor teaches a learner how to assemble and program a simple microcontroller, communicating either through a webcam feed (webcam condition), a field-of-view video feed (HMC condition), or a field-of-view video feed with a gaze location pointer (gaze condition). We find that learning gain is highest in the gaze condition, especially for low achievers. Moreover, instructors predict learner post-test scores more accurately with gaze visualizations, suggesting gaze sharing can help instructors track the cognitive state of the learner. This effect was also most salient for low achievers. We find that in the HMC condition that only lacked this single dot, many of the benefits for both learning and teaching were lost. The paper concludes with discussions on how gaze visualization may support learning and teaching, and on the tool's limitations and conditions for usefulness.
An eye-tracking study of how coach's nonverbal communication affects memorization of basketball tactical scenes

Houssem Ben Chikha,Bachir Zoudji,Aïmen Khacharem

DOI: https://doi.org/10.1177/17479541231177003

2023-05-25

Abstract:International Journal of Sports Science &Coaching, Ahead of Print. Numerous studies have been conducted to examine the effects of an instructor's pointing gestures on learning performance across a wide range of academic domains. There are, however, few clear instructional guidelines for enhancing learning from this visual guidance. This study tested the combined effects of the coach's pointing gesture and gaze guidance on attention and recall performance in field-based sports. This study used a 3 (control vs. gesture vs. gesture/gaze) × 2 (novice vs. expert) between-subjects factorial design. Results showed a significant interaction effect between expertise level and experimental conditions on visual attention and memorization performance. Novice players scored higher after studying tactical instructions with pointing gestures and gaze guidance than players who studied the same instructions with pointing gestures, who in turn performed better than players who received instructions without cues. Expert players showed the same level of performance when they received the instructions without cues and with pointing gestures. However, they showed lower performance (notably in the visual attention and the mental effort measures) when they received the video with pointing gestures and gaze guidance compared to the instructions without gestures and with pointing gestures. These results suggest that the effectiveness of nonverbal visual guidance changes depending on the players' level of expertise.

hospitality, leisure, sport & tourism,psychology, applied
Skill acquisition and gaze behavior during laparoscopic surgical simulation

Sicong Liu,Rachel Donaldson,Ashwin Subramaniam,Hannah Palmer,Cosette Champion,Morgan L. Cox,L. Gregory Appelbaum

DOI: https://doi.org/10.1101/2020.07.17.206763

2020-07-17

Abstract:Abstract Background Experts consistently exhibit more efficient gaze behaviors than non-experts during motor tasks. In surgery, experts have been shown to gaze more at surgical targets than surgical tools during simple simulations and when watching surgical recordings, suggesting a proactive control strategy with greater use of feedforward visual sampling. To investigate such expert gaze behaviors in a more dynamic and complex laparoscopic surgery simulation, the current study measured and compared gaze patterns between surgeons and novices who practiced extensively with laparoscopic simulation. Methods Three surgeons were assessed in a testing visit and five novices were trained and assessed (at pre-, mid-, and post-training points) in a 5-visit protocol on the Fundamentals of Laparoscopic Surgery peg transfer task. The task was adjusted to have a fixed action sequence to allow recordings of dwell durations based on pre-defined areas of interest (AOIs). Novices’ individualized learning curves were analyzed using an inverse function model, and group-level differences were tested using analysis of variance on both behavioral performance and dwell duration measures. Results Trained novices were shown to reach more than 98% ( M = 98.62%, SD = 1.06%) of their behavioral learning plateaus, leading to equivalent behavioral performance to that of surgeons. Despite this equivalence in behavioral performance, surgeons continued to show significantly shorter dwell durations at visual targets of current actions and longer dwell durations at future steps in the action sequence than trained novices ( ps ≤ .03, Cohen’s ds > 2). Conclusion This study demonstrates that, whereas novices can train to match surgeons on behavioral performance, their gaze pattern is still less efficient than that of surgeons, suggesting that eye-tracking metrics might be more sensitive than behavioral performance in detecting surgical expertise. Such insight can be applied to develop training protocols so non-experts can internalize experts’ “gaze templates” to accelerate learning. Article Summary Gaze pattern differences persist between laparoscopic surgery experts and novices who have been trained to reach over 98% of individualized behavioral learning plateaus in the Fundamentals of Laparoscopic Surgery (FLS) peg transfer task. The importance of this finding lies in motivating the decision and method of including gaze behaviors via eyetracking technology in the present surgical training programs.
Supporting Mitosis Detection AI Training with Inter-Observer Eye-Gaze Consistencies

Hongyan Gu,Zihan Yan,Ayesha Alvi,Brandon Day,Chunxu Yang,Zida Wu,Shino Magaki,Mohammad Haeri,Xiang 'Anthony' Chen

2024-04-02

Abstract:The expansion of artificial intelligence (AI) in pathology tasks has intensified the demand for doctors' annotations in AI development. However, collecting high-quality annotations from doctors is costly and time-consuming, creating a bottleneck in AI progress. This study investigates eye-tracking as a cost-effective technology to collect doctors' behavioral data for AI training with a focus on the pathology task of mitosis detection. One major challenge in using eye-gaze data is the low signal-to-noise ratio, which hinders the extraction of meaningful information. We tackled this by levering the properties of inter-observer eye-gaze consistencies and creating eye-gaze labels from consistent eye-fixations shared by a group of observers. Our study involved 14 non-medical participants, from whom we collected eye-gaze data and generated eye-gaze labels based on varying group sizes. We assessed the efficacy of such eye-gaze labels by training Convolutional Neural Networks (CNNs) and comparing their performance to those trained with ground truth annotations and a heuristic-based baseline. Results indicated that CNNs trained with our eye-gaze labels closely followed the performance of ground-truth-based CNNs, and significantly outperformed the baseline. Although primarily focused on mitosis, we envision that insights from this study can be generalized to other medical imaging tasks.

Computer Vision and Pattern Recognition
On Smart Gaze based Annotation of Histopathology Images for Training of Deep Convolutional Neural Networks

Komal Mariam,Osama Mohammed Afzal,Wajahat Hussain,Muhammad Umar Javed,Amber Kiyani,Nasir Rajpoot,Syed Ali Khurram,Hassan Aqeel Khan

DOI: https://doi.org/10.1109/JBHI.2022.3148944

2022-02-06

Abstract:Unavailability of large training datasets is a bottleneck that needs to be overcome to realize the true potential of deep learning in histopathology applications. Although slide digitization via whole slide imaging scanners has increased the speed of data acquisition, labeling of virtual slides requires a substantial time investment from pathologists. Eye gaze annotations have the potential to speed up the slide labeling process. This work explores the viability and timing comparisons of eye gaze labeling compared to conventional manual labeling for training object detectors. Challenges associated with gaze based labeling and methods to refine the coarse data annotations for subsequent object detection are also discussed. Results demonstrate that gaze tracking based labeling can save valuable pathologist time and delivers good performance when employed for training a deep object detector. Using the task of localization of Keratin Pearls in cases of oral squamous cell carcinoma as a test case, we compare the performance gap between deep object detectors trained using hand-labelled and gaze-labelled data. On average, compared to `Bounding-box' based hand-labeling, gaze-labeling required $57.6\%$ less time per label and compared to `Freehand' labeling, gaze-labeling required on average $85\%$ less time per label.

Image and Video Processing,Computer Vision and Pattern Recognition
Scene-dependent, feedforward eye gaze metrics can differentiate technical skill levels of trainees in laparoscopic surgery

Chaitanya S. Kulkarni,Shiyu Deng,Tianzi Wang,Jacob Hartman-Kenzler,Laura E. Barnes,Sarah Henrickson Parker,Shawn D. Safford,Nathan Lau

DOI: https://doi.org/10.1007/s00464-022-09582-3

2022-09-19

Surgical Endoscopy

Abstract:IntroductionIn laparoscopic surgery, looking in the target areas is an indicator of proficiency. However, gaze behaviors revealing feedforward control (i.e., looking ahead) and their importance have been under-investigated in surgery. This study aims to establish the sensitivity and relative importance of different scene-dependent gaze and motion metrics for estimating trainee proficiency levels in surgical skills.MethodsMedical students performed the Fundamentals of Laparoscopic Surgery peg transfer task while recording their gaze on the monitor and tool activities inside the trainer box. Using computer vision and fixation algorithms, five scene-dependent gaze metrics and one tool speed metric were computed for 499 practice trials. Cluster analysis on the six metrics was used to group the trials into different clusters/proficiency levels, and ANOVAs were conducted to test differences between proficiency levels. A Random Forest model was trained to study metric importance at predicting proficiency levels.ResultsThree clusters were identified, corresponding to three proficiency levels. The correspondence between the clusters and proficiency levels was confirmed by differences between completion times (F2,488 = 38.94, p < .001). Further, ANOVAs revealed significant differences between the three levels for all six metrics. The Random Forest model predicted proficiency level with 99% out-of-bag accuracy and revealed that scene-dependent gaze metrics reflecting feedforward behaviors were more important for prediction than the ones reflecting feedback behaviors.ConclusionScene-dependent gaze metrics revealed skill levels of trainees more precisely than between experts and novices as suggested in the literature. Further, feedforward gaze metrics appeared to be more important than feedback ones at predicting proficiency.Graphical abstract

surgery
Gaze2Segment: A Pilot Study for Integrating Eye-Tracking Technology into Medical Image Segmentation

Naji Khosravan,Haydar Celik,Baris Turkbey,Ruida Cheng,Evan McCreedy,Matthew McAuliffe,Sandra Bednarova,Elizabeth Jones,Xinjian Chen,Peter L. Choyke,Bradford J. Wood,Ulas Bagci

DOI: https://doi.org/10.48550/arXiv.1608.03235

2016-08-11

Abstract:This study introduced a novel system, called Gaze2Segment, integrating biological and computer vision techniques to support radiologists' reading experience with an automatic image segmentation task. During diagnostic assessment of lung CT scans, the radiologists' gaze information were used to create a visual attention map. This map was then combined with a computer-derived saliency map, extracted from the gray-scale CT images. The visual attention map was used as an input for indicating roughly the location of a object of interest. With computer-derived saliency information, on the other hand, we aimed at finding foreground and background cues for the object of interest. At the final step, these cues were used to initiate a seed-based delineation process. Segmentation accuracy of the proposed Gaze2Segment was found to be 86% with dice similarity coefficient and 1.45 mm with Hausdorff distance. To the best of our knowledge, Gaze2Segment is the first true integration of eye-tracking technology into a medical image segmentation task without the need for any further user-interaction.

Computer Vision and Pattern Recognition,Artificial Intelligence

Fiber optics communications. Edited by Henry f. Taylor.

Impact of an educational intervention on eye gaze behaviour in retinal image interpretation by consultant and trainee ophthalmologists

Eye Gaze Perception and Gaze Cueing Effect

Cheating experience: Guiding novices to adopt the gaze strategies of experts expedites the learning of technical laparoscopic skills

EYE-ECG: An RCT of the influence of student characteristics and expert eye-tracking videos with cued retrospective reporting on students' ECG interpretation skills

Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: a randomized, controlled study

Gaze training improves the retention and transfer of laparoscopic technical skills in novices

A new way to look at simulation-based assessment: the relationship between gaze-tracking and exam performance

Medical imaging training with eye movement modeling examples: A randomized controlled study

Developing expert gaze pattern in laparoscopic surgery requires more than behavioral training

[Traumatic dislocation of the hip with fracture of neck of femur].

See Like an Expert: Gaze-Augmented Training Enhances Skill Acquisition in a Virtual Reality Robotic Suturing Task

Virtual pointer for gaze guidance in laparoscopic surgery

A New Method to Evaluate Gaze Behavior Patterns in Doctor-Patient Interaction

Learners Learn More and Instructors Track Better with Real-time Gaze Sharing

An eye-tracking study of how coach's nonverbal communication affects memorization of basketball tactical scenes

Skill acquisition and gaze behavior during laparoscopic surgical simulation

Supporting Mitosis Detection AI Training with Inter-Observer Eye-Gaze Consistencies

On Smart Gaze based Annotation of Histopathology Images for Training of Deep Convolutional Neural Networks

Scene-dependent, feedforward eye gaze metrics can differentiate technical skill levels of trainees in laparoscopic surgery

Gaze2Segment: A Pilot Study for Integrating Eye-Tracking Technology into Medical Image Segmentation