Wrist Accelerometer Analysis of Competent Versus Expert Laparoscopic Surgeons

J.H. Chen,E. Wade,C. Zeisler,S. Ghanimanti,J.Z. Wei,C. Templeman

DOI: https://doi.org/10.1016/j.jmig.2013.08.348

IF: 4.314

2013-01-01

Journal of Minimally Invasive Gynecology

Abstract:This is a pilot study to determine differences in surgical movement between laparoscopic surgeons designated as competent versus expert during a laparoscopic skills lab.

What problem does this paper attempt to address?

Proficiency assessment of gesture analysis in laparoscopy by means of the surgeon's musculo-skeleton model

Filippo Cavallo,Andrea Pietrabissa,Giuseppe Megali,Elena Troia,Stefano Sinigaglia,Paolo Dario,Franco Mosca,Alfred Cuschieri

DOI: https://doi.org/10.1097/SLA.0b013e318238350e

Abstract:Objective: This article presents the implementation of surgeon's musculo-skeletal model for gesture analysis in laparoscopy, thereby providing a complete account of the objective metrics needed to evaluate surgical performance and to improve the design of new surgical instruments including robotic instrumentation for surgical procedures. Background: Previous published work has been based exclusively on the kinematics involved whereas, this study is focused on the dynamics and muscle contraction analysis to assess loads on bones and muscle fatigue during simulation of surgical interventions. Methods: Nine medical students and 2 fully trained surgeons participated in the experimental sessions using a virtual laparoscopic simulator. Movement was acquired by means of an Optical Localization System and processed by means of the biomechanical software platform ADAMS-LifeMOD. Results: The musculo-skeletal analysis allows calculation of how the muscles are used and their respective mean work during the exercises. Results, relative to biceps and trapezius for left and right arm, clearly demonstrate different proficiencies between surgeons and medical students and highlight differences in using different surgical instruments and assumption of different postures. Conclusions: The model provides data on the evaluation of biomechanical parameters of surgical gesture not only in kinematic terms but also includes analysis of the dynamics of muscle contraction analysis during surgical manipulations.
Handheld Laparoscopic Robotized Instrument: Progress or Challenge?

Jing Feng,Kun Yang,Zhang,Man Li,XiaoJia Chen,Zhiyuan Yan,Zhijiang Du,XingHuan Wang

DOI: https://doi.org/10.1007/s00464-019-06820-z

2019-01-01

Surgical Endoscopy

Abstract:BACKGROUND:Handheld laparoscopic robotized instruments have been developed to combine the advantages of a robotic operation system and conventional laparoscopic instruments. Direct objective standards are needed to quantify surgeons' skill level and validate the advantages of new instruments. This study describes and objectively evaluates the use of a robotized instrument using a force-sensing test platform. METHODS:The test platform consists of 12 rings on a hypersensitive force sensor. Forty volunteers were recruited: the expert group included 20 laparoscopic experts and the novice group included 20 medical students in their 4th year without laparoscopic skills. The baseline of the two groups was identified using a conventional needle holder. Participants then repeated the test with the robotized needle holder after training. The maximum force and impulse of each ring were analyzed for each group. Institutional review board approval is not needed for this study. RESULTS:Significantly lower maximum force and impulse were observed in the expert group than in the novice group during the baseline test (all P < 0.05). After training, a significant difference remained in maximum force and impulse between the two groups using the robotized needle holder (all P < 0.05). Within each group, there was no difference in maximum force or impulse using the robotized needle holder after training compared to that on using the conventional needle holder (all P > 0.05). CONCLUSIONS:The maximum force and impulse recorded by a test platform can accurately identify participants' laparoscopic skill level. Six hours' training can ensure that experts master the use of the robotized needle holder, but this training session is too short for novices to improve their performance with a new instrument. The force-sensing test platform can reflect the suturing characteristics of users based on the skill level and is useful for laparoscopic suture training.
Defining the competencies for laparoscopic transabdominal adrenalectomy: An investigation of intraoperative behaviors and decisions of experts

Amin Madani,Karan Grover,Jennifer H Kuo,Elliot J Mitmaker,Wen Shen,Toni Beninato,Masha Livhits,Philip W Smith,Barbra S Miller,Rebecca S Sippel,Quan-Yang Duh,James A Lee

DOI: https://doi.org/10.1016/j.surg.2019.03.035

IF: 4.348

Surgery

Abstract:Background: Safe performance of laparoscopic transabdominal adrenalectomy requires the application of a complex body of knowledge and skills, which are difficult to define, teach, and measure. This qualitative study aims to characterize expert behaviors, decisions, and other cognitive processes required to perform laparoscopic transabdominal adrenalectomy. Method: Hierarchical and cognitive task analyses for right and left laparoscopic transabdominal adrenalectomy were performed using semi-structured interviews and field observations of experts. Verbal data was supplemented with published literature, coded and thematically analyzed using constructivist grounded-theory by 2 independent reviewers. Results: A conceptual framework was synthesized. Sixty-eight tasks, 46 cognitive behaviors, and 52 potential errors were identified and categorized into 8 procedural steps and 8 fundamental principles: anticipation, exposure, teamwork or communication, physiology, dissection techniques, oncologic margins, tactical modification, and error recovery. Experts emphasized the importance of creating a 3-dimensional mental model of the anatomy or pathology (eg, aberrant vessels, tumor location) that is consistently fine-tuned throughout the operation, with conscious awareness of danger zones (eg, medial arc). Despite variations in dissection techniques, experts highlighted 2 themes: macrodissection and microdissection, with emphasis on nonlinear motions and effective transitions between the 2 when appropriate. Conclusion: This study defines behaviors and competencies that are essential to performing laparoscopic transabdominal adrenalectomy effectively and safely.
Laparoscopic surgical skill evaluation with motion capture and eyeglass gaze cameras: A pilot study

Shiro Matsumoto,Hiroshi Kawahira,Kosuke Oiwa,Yoshitaka Maeda,Akio Nozawa,Alan Kawarai Lefor,Yoshinori Hosoya,Naohiro Sata

DOI: https://doi.org/10.1111/ases.13065

Abstract:Introduction: An eyeglass gaze camera and a skeletal coordinate camera without sensors attached to the operator's body were used to monitor gaze and movement during a simulated surgical procedure. These new devices have the potential to change skill assessment for laparoscopic surgery. The suitability of these devices for skill assessment was investigated. Material and methods: Six medical students, six intermediate surgeons, and four experts performed suturing tasks in a dry box. The tip positions of the instruments were identified from video recordings. Performance was evaluated based on instrument movement, gaze, and skeletal coordination. Results: Task performance time and skeletal coordinates were not significantly different among skill levels. The total movement distance of the right instrument was significantly different depending on the skill level. The SD of the gaze coordinates was significantly different depending on skill level and was less for experts. The expert's gaze stayed in a small area with little blurring. Conclusions: The SD of gaze point coordinates correlates with laparoscopic surgical skill level. These devices may facilitate objective intraoperative skill evaluation in future studies.
Comparative Study of the Use of Different Sizes of an Ergonomic Instrument Handle for Laparoscopic Surgery

Juan A. Sánchez-Margallo,Alfonso González González,Lorenzo García Moruno,J. Carlos Gómez-Blanco,J. Blas Pagador,Francisco M. Sánchez-Margallo

DOI: https://doi.org/10.3390/app10041526

2020-02-24

Applied Sciences

Abstract:Previous studies have shown that the handle design of laparoscopic instruments is crucial to surgical performance and surgeon’s ergonomics. In this study, four different sizes of an ergonomic laparoscopic handle design were tested in a blind and randomized fashion with twelve surgeons. They performed three laparoscopic tasks in order to analyze the influence of handle size. Execution time, wrist posture, and finger and palm pressure were evaluated during the performance of each task. The results show a significant reduction in the time required to complete the eye-manual coordination task using the appropriate handle. The incorrectly sized handle resulted in a rise in palm pressure and a reduction in the force exerted by the thumb during the transfer task. In the hand-eye coordination task, the use of the right handle size led to an increase in middle finger pressure. In general, surgeons had an ergonomically adequate wrist flexion in all tasks and an acceptable radio-ulnar deviation during the transfer task using the ergonomic instrument handle. Surgeons found it comfortable the use of the ergonomic handle. Therefore, the use of an appropriately sized instrument handle allows surgeons to improve ergonomics and surgical performance during the laparoscopic practice.
Using Artificial Intelligence to Gauge Competency on a Novel Laparoscopic Training System

C Yoonhee Ryder,Nicole M Mott,Christopher L Gross,Chioma Anidi,Leul Shigut,Serena S Bidwell,Erin Kim,Yimeng Zhao,Blessing Ngoin Ngam,Mark J Snell,B Joon Yu,Pawel Forczmanski,Deborah M Rooney,David R Jeffcoach,Grace J Kim

DOI: https://doi.org/10.1016/j.jsurg.2023.10.007

Abstract:Objective: Laparoscopic surgical skill assessment and machine learning are often inaccessible to low-and-middle-income countries (LMIC). Our team developed a low-cost laparoscopic training system to teach and assess psychomotor skills required in laparoscopic salpingostomy in LMICs. We performed video review using AI to assess global surgical techniques. The objective of this study was to assess the validity of artificial intelligence (AI) generated scoring measures of laparoscopic simulation videos by comparing the accuracy of AI results to human-generated scores. Design: Seventy-four surgical simulation videos were collected and graded by human participants using a modified OSATS (Objective Structured Assessment of Technical Skills). The videos were then analyzed via AI using 3 different time and distance-based calculations of the laparoscopic instruments including path length, dimensionless jerk, and standard deviation of tool position. Predicted scores were generated using 5-fold cross validation and K-Nearest-Neighbors to train classifiers. Setting: Surgical novices and experts from a variety of hospitals in Ethiopia, Cameroon, Kenya, and the United States contributed 74 laparoscopic salpingostomy simulation videos. Results: Complete accuracy of AI compared to human assessment ranged from 65-77%. There were no statistical differences in rank mean scores for 3 domains, Flow of Operation, Respect for Tissue, and Economy of Motion, while there were significant differences in ratings for Instrument Handling, Overall Performance, and the total summed score of all 5 domains (Summed). Estimated effect sizes were all less than 0.11, indicating very small practical effect. Estimated intraclass correlation coefficient (ICC) of Summed was 0.72 indicating moderate correlation between AI and Human scores. Conclusions: Video review using AI technology of global characteristics was similar to that of human review in our laparoscopic training system. Machine learning may help fill an educational gap in LMICs where direct apprenticeship may not be feasible.
Sensors for expert grip force profiling: towards benchmarking manual control of a robotic device for surgical tool movements

Michel de Mathelin,Florent Nageotte,Philippe Zanne,Birgitta Dresp-Langley

DOI: https://doi.org/10.3390/s19204575

2020-11-12

Abstract:STRAS (Single access Transluminal Robotic Assistant for Surgeons) is a new robotic system for application to intraluminal surgical procedures. Preclinical testing of STRAS has recently permitted to demonstrate major advantages of the system in comparison with classic procedures. Benchmark methods permitting to establish objective criteria for expertise need to be worked out now to effectively train surgeons on this new system in the near future. STRAS consists of three cable driven subsystems, one endoscope serving as guide, and two flexible instruments. The flexible instruments have three degrees of freedom and can be teleoperated by a single user via two specially designed master interfaces. In this study here, small force sensors sewn into a wearable glove to ergonomically fit the master handles of the robotic system were employed for monitoring the forces applied by an expert and a trainee who was a complete novice during all the steps of surgical task execution in a simulator task, a four step pick and drop. Analysis of gripforce profiles is performed sensor by sensor to bring to the fore specific differences in handgrip force profiles in specific sensor locations on anatomically relevant parts of the fingers and hand controlling the master slave system.

Robotics
Perceptual impairment and psychomotor control in virtual laparoscopic surgery

Mark R. Wilson,John S. McGrath,Samuel J. Vine,James Brewer,David Defriend,Richard S. W. Masters

DOI: https://doi.org/10.1007/s00464-010-1546-4

2011-02-27

Surgical Endoscopy

Abstract:BackgroundIt is recognised that one of the major difficulties in performing laparoscopic surgery is the translation of two-dimensional video image information to a three-dimensional working area. However, research has tended to ignore the gaze and eye-hand coordination strategies employed by laparoscopic surgeons as they attempt to overcome these perceptual constraints. This study sought to examine if measures related to tool movements, gaze strategy, and eye-hand coordination (the quiet eye) differentiate between experienced and novice operators performing a two-handed manoeuvres task on a virtual reality laparoscopic surgical simulator (LAP Mentor™).MethodsTwenty-five right-handed surgeons were categorised as being either experienced (having led more than 60 laparoscopic procedures) or novice (having performed fewer than 10 procedures) operators. The 10 experienced and 15 novice surgeons completed the “two-hand manoeuvres” task from the LAP Mentor basic skills learning environment while wearing a gaze registration system. Performance, movement, gaze, and eye-hand coordination parameters were recorded and compared between groups.ResultsThe experienced surgeons completed the task significantly more quickly than the novices, used significantly fewer movements, and displayed shorter tool paths. Gaze analyses revealed that experienced surgeons spent significantly more time fixating the target locations than novices, who split their time between focusing on the targets and tracking the tools. A more detailed analysis of a difficult subcomponent of the task revealed that experienced operators used a significantly longer aiming fixation (the quiet eye period) to guide precision grasping movements and hence needed fewer grasp attempts.ConclusionThe findings of the study provide further support for the utility of examining strategic gaze behaviour and eye-hand coordination measures to help further our understanding of how experienced surgeons attempt to overcome the perceptual difficulties inherent in the laparoscopic environment.

English Else
Mechanical Evaluation of Articulating Instruments and Cross-Handed Manipulation in Laparoendoscopic Single-Site Surgery

An,Jiang Fan Zhu,Xiaofeng Xie,Yuantao Su

DOI: https://doi.org/10.1177/1553350613509727

2013-01-01

Surgical Innovation

Abstract:Background. Laparoendoscopic single-site surgery (LESS) is limited by loss of triangulation and internal instruments conflict. To overcome these difficulties, some concepts have been introduced, namely, articulating instruments and cross-handed manipulation, which causes the right hand to control the left instrument tip and vice versa. The aim of this study was to compare task performance with different approaches based on a mechanical evaluation platform. Methods. A LESS mechanical evaluation platform was set up to investigate the performance of 2 tasks (suture pass-through rings and clip-cut) with 3 different settings: uncrossed manipulation with straight instruments (group A, the control group), uncrossed manipulation with articulating instruments (group B), and cross-handed manipulation with articulating instruments (group C). The operation time and average load required for accomplishment of the standard tasks were measured. Results. Group A presented significantly better time scores than group B, and group C consumed the longest time to accomplish the 2 tasks ( P < .05). Comparing of average load required to perform the suture pass-through rings task, it differed significantly between dominant and nondominant hand in all groups ( P < .01) and was less in group A and group B than group C in dominant hand ( P < .01), while it was almost the same in all groups in the nondominant hand. In terms of average load requirement to accomplish clip-cut task, it was almost equal not only between group A and B but also between dominant and nondominant hand while the increase reached statistical significance when comparing group C with other groups ( P < .05). Conclusions. Compared with conventional devices and maneuvering techniques, articulating instruments and cross-handed manipulation are associated with longer operation time and higher workload. Instruments with better maneuverability should be developed in the future for LESS.
Comparative Study of Ergonomics in Conventional and Robotic-Assisted Laparoscopic Surgery

Manuel J. Pérez-Salazar,Daniel Caballero,Juan A. Sánchez-Margallo,Francisco M. Sánchez-Margallo

DOI: https://doi.org/10.3390/s24123840

IF: 3.9

2024-06-14

Sensors

Abstract:BACKGROUND: This study aims to implement a set of wearable technologies to record and analyze the surgeon's physiological and ergonomic parameters during the performance of conventional and robotic-assisted laparoscopic surgery, comparing the ergonomics and stress levels of surgeons during surgical procedures. METHODS: This study was organized in two different settings: simulator tasks and experimental model surgical procedures. The participating surgeons performed the tasks and surgical procedures in both laparoscopic and robotic-assisted surgery in a randomized fashion. Different wearable technologies were used to record the surgeons' posture, muscle activity, electrodermal activity and electrocardiography signal during the surgical practice. RESULTS: The simulator study involved six surgeons: three experienced (>100 laparoscopic procedures performed; 36.33 ± 13.65 years old) and three novices ( 100 laparoscopic procedures performed; 37.00 ± 5.29 years old), but without experience in surgical robotics, participated in the experimental model study. The participating surgeons showed an increased level of stress during the robotic-assisted surgical procedures. Overall, improved surgeon posture was obtained during robotic-assisted surgery, with a reduction in localized muscle fatigue. CONCLUSIONS: A set of wearable technologies was implemented to measure and analyze surgeon physiological and ergonomic parameters. Robotic-assisted procedures showed better ergonomic outcomes for the surgeon compared to conventional laparoscopic surgery. Ergonomic analysis allows us to optimize surgeon performance and improve surgical training.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical
Skill acquisition and gaze behavior during laparoscopic surgical simulation

Sicong Liu,Rachel Donaldson,Ashwin Subramaniam,Hannah Palmer,Cosette Champion,Morgan L. Cox,L. Gregory Appelbaum

DOI: https://doi.org/10.1101/2020.07.17.206763

2020-07-17

Abstract:Abstract Background Experts consistently exhibit more efficient gaze behaviors than non-experts during motor tasks. In surgery, experts have been shown to gaze more at surgical targets than surgical tools during simple simulations and when watching surgical recordings, suggesting a proactive control strategy with greater use of feedforward visual sampling. To investigate such expert gaze behaviors in a more dynamic and complex laparoscopic surgery simulation, the current study measured and compared gaze patterns between surgeons and novices who practiced extensively with laparoscopic simulation. Methods Three surgeons were assessed in a testing visit and five novices were trained and assessed (at pre-, mid-, and post-training points) in a 5-visit protocol on the Fundamentals of Laparoscopic Surgery peg transfer task. The task was adjusted to have a fixed action sequence to allow recordings of dwell durations based on pre-defined areas of interest (AOIs). Novices’ individualized learning curves were analyzed using an inverse function model, and group-level differences were tested using analysis of variance on both behavioral performance and dwell duration measures. Results Trained novices were shown to reach more than 98% ( M = 98.62%, SD = 1.06%) of their behavioral learning plateaus, leading to equivalent behavioral performance to that of surgeons. Despite this equivalence in behavioral performance, surgeons continued to show significantly shorter dwell durations at visual targets of current actions and longer dwell durations at future steps in the action sequence than trained novices ( ps ≤ .03, Cohen’s ds > 2). Conclusion This study demonstrates that, whereas novices can train to match surgeons on behavioral performance, their gaze pattern is still less efficient than that of surgeons, suggesting that eye-tracking metrics might be more sensitive than behavioral performance in detecting surgical expertise. Such insight can be applied to develop training protocols so non-experts can internalize experts’ “gaze templates” to accelerate learning. Article Summary Gaze pattern differences persist between laparoscopic surgery experts and novices who have been trained to reach over 98% of individualized behavioral learning plateaus in the Fundamentals of Laparoscopic Surgery (FLS) peg transfer task. The importance of this finding lies in motivating the decision and method of including gaze behaviors via eyetracking technology in the present surgical training programs.
Assessing Arthroscopic Skills Using Wireless Elbow-Worn Motion Sensors.

Georgina S. J. Kirby,Paul Guyver,Louise Strickland,Abtin Alvand,Guang-Zhong Yang,Caroline Hargrove,Benny P. L. Lo,Jonathan L. Rees

DOI: https://doi.org/10.2106/jbjs.n.01043

2015-01-01

Journal of Bone and Joint Surgery

Abstract:BACKGROUNDAssessment of surgical skill is a critical component of surgical training. Approaches to assessment remain predominantly subjective, although more objective measures such as Global Rating Scales are in use. This study aimed to validate the use of elbow-worn, wireless, miniaturized motion sensors to assess the technical skill of trainees performing arthroscopic procedures in a simulated environment.METHODSThirty participants were divided into three groups on the basis of their surgical experience: novices (n = 15), intermediates (n = 10), and experts (n = 5). All participants performed three standardized tasks on an arthroscopic virtual reality simulator while wearing wireless wrist and elbow motion sensors. Video output was recorded and a validated Global Rating Scale was used to assess performance; dexterity metrics were recorded from the simulator. Finally, live motion data were recorded via Bluetooth from the wireless wrist and elbow motion sensors and custom algorithms produced an arthroscopic performance score.RESULTSConstruct validity was demonstrated for all tasks, with Global Rating Scale scores and virtual reality output metrics showing significant differences between novices, intermediates, and experts (p < 0.001). The correlation of the virtual reality path length to the number of hand movements calculated from the wireless sensors was very high (p < 0.001). A comparison of the arthroscopic performance score levels with virtual reality output metrics also showed highly significant differences (p < 0.01). Comparisons of the arthroscopic performance score levels with the Global Rating Scale scores showed strong and highly significant correlations (p < 0.001) for both sensor locations, but those of the elbow-worn sensors were stronger and more significant (p < 0.001) than those of the wrist-worn sensors.CONCLUSIONSA new wireless assessment of surgical performance system for objective assessment of surgical skills has proven valid for assessing arthroscopic skills. The elbow-worn sensors were shown to achieve an accurate assessment of surgical dexterity and performance.CLINICAL RELEVANCEThe validation of an entirely objective assessment of arthroscopic skill with wireless elbow-worn motion sensors introduces, for the first time, a feasible assessment system for the live operating theater with the added potential to be applied to other surgical and interventional specialties.
Hand Motion Analysis Using Accelerometer-Based Sensors and Sheep's Head Model for Basic Training in Functional Endoscopic Sinus Surgery

Constantin Stan,Peter L Ujvary,Cristina Blebea,Mihai I Tănase,Mara Tănase,Septimiu Sever Pop,Alma A Maniu,Marcel Cosgarea,Doinel G Rădeanu

DOI: https://doi.org/10.7759/cureus.59725

2024-05-06

Cureus

Abstract:Introduction: Motion analysis, the study of movement patterns to evaluate performance, plays a crucial role in surgical training. It provides objective data that can be used to assess and improve trainee's precision, efficiency, and overall surgical technique. The primary aim of this study is to employ accelerometer-based sensors placed on the wrist to analyze hand motions during endoscopic sinus surgery training using the sheep's head. By capturing detailed movement data, the study seeks to quantify the motion characteristics that distinguish different levels of surgical expertise. This approach seeks to quantify motion characteristics indicative of surgical expertise and enhance the objectivity and effectiveness of surgical training feedback mechanisms. Materials and methods: Twenty-four participants were divided into three groups based on their experience with endoscopic endonasal surgery. Each participant was tasked with performing specified procedures on an individual sheep's head, concentrating on exploring both nasal passages. A single Bluetooth Accelerometer WitMotion sensor was mounted on the dorsal surface of each hand. This facilitates the evaluation of efficiency parameters such as time, path length, and acceleration during the training procedures. Accelerometer data were collected and imported in CSV format (comma-separated values) for each group of surgeons-senior, specialist, and resident-mean values and standard deviations were computed. The Shapiro-Wilk Test assessed the normality of the distribution. The Kruskal-Wallis test was employed to compare procedural time, acceleration, and path length differences across the three surgeon experience levels. Results: For the procedural time, statistical significance appears in all surgical steps (p<0.001), with the biggest difference in the septoplasty group in favor of the senior group. A clear difference can be observed between the resulting acceleration of the dominant hands (instrument hand) and the non-dominant hand (endoscopic hand) and between the study groups. The difference between groups reaches statistical significance with a p-value <0.001. A statistically significant difference can be seen between the paths covered by each hand of every participant (p<0.001). Also, senior doctors covered significantly less movement with both hands than the specialists and the resident doctors (p<0.001). Conclusions: The data show a clear learning curve from resident to senior, with residents taking more time and using more hand movements to complete the same tasks. Specialists are in the intermediate phase, showing signs of honing their technique towards efficiency. This comprehensive data set can help tailor training programs to focus on both efficiency (quicker procedures) and economy of motion (reduced path length and acceleration), especially in more complex procedures where the difference in performance is more pronounced.
Crossover-effects in technical skills between laparoscopy and robot-assisted surgery

Sem F Hardon,E Willuth,A Masie Rahimi,F Lang,Caelan M Haney,Eleni A Felinska,Karl-Friedrich Kowalewski,Beat P Müller-Stich,Donald L van der Peet,Freek Daams,F Nickel,Tim Horeman

DOI: https://doi.org/10.1007/s00464-023-10045-6

Abstract:Introduction: Robot-assisted surgery is often performed by experienced laparoscopic surgeons. However, this technique requires a different set of technical skills and surgeons are expected to alternate between these approaches. The aim of this study is to investigate the crossover effects when switching between laparoscopic and robot-assisted surgery. Methods: An international multicentre crossover study was conducted. Trainees with distinctly different levels of experience were divided into three groups (novice, intermediate, expert). Each trainee performed six trials of a standardized suturing task using a laparoscopic box trainer and six trials using the da Vinci surgical robot. Both systems were equipped with the ForceSense system, measuring five force-based parameters for objective assessment of tissue handling skills. Statistical comparison was done between the sixth and seventh trial to identify transition effects. Unexpected changes in parameter outcomes after the seventh trial were further investigated. Results: A total of 720 trials, performed by 60 participants, were analysed. The expert group increased their tissue handling forces with 46% (maximum impulse 11.5 N/s to 16.8 N/s, p = 0.05), when switching from robot-assisted surgery to laparoscopy. When switching from laparoscopy to robot-assisted surgery, intermediates and experts significantly decreased in motion efficiency (time (sec), resp. 68 vs. 100, p = 0.05, and 44 vs. 84, p = 0.05). Further investigation between the seventh and ninth trial showed that the intermediate group increased their force exertion with 78% (5.1 N vs. 9.1 N, p = 0.04), when switching to robot-assisted surgery. Conclusion: The crossover effects in technical skills between laparoscopic and robot-assisted surgery are highly depended on the prior experience with laparoscopic surgery. Where experts can alternate between approaches without impairment of technical skills, novices and intermediates should be aware of decay in efficiency of movement and tissue handling skills that could impact patient safety. Therefore, additional simulation training is advised to prevent from undesired events.
Force-Sensing Enhanced Simulation Environment (forsense) for Laparoscopic Surgery Training and Assessment

Thomas P. Cundy,Evelyn Thangaraj,Hedyeh Rafii-Tari,Christopher J. Payne,Georges Azzie,Mikael H. Sodergren,Guang-Zhong Yang,Ara Darzi

DOI: https://doi.org/10.1016/j.surg.2014.10.015

IF: 4.348

2015-01-01

Surgery

Abstract:BACKGROUND:Excessive or inappropriate tissue interaction force during laparoscopic surgery is a recognized contributor to surgical error, especially for robotic surgery. Measurement of force at the tool-tissue interface is, therefore, a clinically relevant skill assessment variable that may improve effectiveness of surgical simulation. Popular box trainer simulators lack the necessary technology to measure force. The aim of this study was to develop a force sensing unit that may be integrated easily with existing box trainer simulators and to (1) validate multiple force variables as objective measurements of laparoscopic skill, and (2) determine concurrent validity of a revised scoring metric.METHODS:A base plate unit sensitized to a force transducer was retrofitted to a box trainer. Participants of 3 different levels of operative experience performed 5 repetitions of a peg transfer and suture task. Multiple outcome variables of force were assessed as well as a revised scoring metric that incorporated a penalty for force error.RESULTS:Mean, maximum, and overall magnitudes of force were significantly different among the 3 levels of experience, as well as force error. Experts were found to exert the least force and fastest task completion times, and vice versa for novices. Overall magnitude of force was the variable most correlated with experience level and task completion time. The revised scoring metric had similar predictive strength for experience level compared with the standard scoring metric.CONCLUSION:Current box trainer simulators can be adapted for enhanced objective measurements of skill involving force sensing. These outcomes are significantly influenced by level of expertise and are relevant to operative safety in laparoscopic surgery. Conventional proficiency standards that focus predominantly on task completion time may be integrated with force-based outcomes to be more accurately reflective of skill quality.
Objective classification of psychomotor laparoscopic skills of surgeons based on three different approaches

Fernando Pérez-Escamirosa,Antonio Alarcón-Paredes,Gustavo Adolfo Alonso-Silverio,Ignacio Oropesa,Oscar Camacho-Nieto,Daniel Lorias-Espinoza,Arturo Minor-Martínez

DOI: https://doi.org/10.1007/s11548-019-02073-2

Abstract:Background: The determination of surgeons' psychomotor skills in minimally invasive surgery techniques is one of the major concerns of the programs of surgical training in several hospitals. Therefore, it is important to assess and classify objectively the level of experience of surgeons and residents during their training process. The aim of this study was to investigate three classification methods for establishing automatically the level of surgical competence of the surgeons based on their psychomotor laparoscopic skills. Methods: A total of 43 participants, divided into an experienced surgeons group with ten experts (> 100 laparoscopic procedures performed) and non-experienced surgeons group with 24 residents and nine medical students (< 10 laparoscopic procedures performed), performed three tasks in the EndoViS training system. Motion data of the instruments were captured with a video-tracking system built into the EndoViS simulator and analyzed using 13 motion analysis parameters (MAPs). Radial basis function networks (RBFNets), K-star (K*), and random forest (RF) were used for classifying surgeons based on the MAPs' scores of all participants. The performance of the three classifiers was examined using hold-out and leave-one-out validation techniques. Results: For all three tasks, the K-star method was superior in terms of accuracy and AUC in both validation techniques. The mean accuracy of the classifiers was 93.33% for K-star, 87.58% for RBFNets, and 84.85% for RF in hold-out validation, and 91.47% for K-star, 89.92% for RBFNets, and 83.72% for RF in leave-one-out cross-validation. Conclusions: The three proposed methods demonstrated high performance in the classification of laparoscopic surgeons, according to their level of psychomotor skills. Together with motion analysis and three laparoscopic tasks of the Fundamental Laparoscopic Surgery Program, these classifiers provide a means for objectively classifying surgical competence of the surgeons for existing laparoscopic box trainers.
Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies

Zixin Chen,Dewei Yang,Ang Li,Louzong Sun,Jifan Zhao,Jie Liu,Linxun Liu,Xiaobo Zhou,Yonghua Chen,Yunqiang Cai,Zhong Wu,Ke Cheng,He Cai,Ming Tang,Bing Peng,Xin Wang

DOI: https://doi.org/10.1097/JS9.0000000000000975

2024-03-01

Abstract:Background: Various surgical skills lead to differences in patient outcomes and identifying poorly skilled surgeons with constructive feedback contributes to surgical quality improvement. The aim of the study was to develop an algorithm for evaluating surgical skills in laparoscopic cholecystectomy based on the features of elementary functional surgical gestures (Surgestures). Materials and methods: Seventy-five laparoscopic cholecystectomy videos were collected from 33 surgeons in five hospitals. The phase of mobilization hepatocystic triangle and gallbladder dissection from the liver bed of each video were annotated with 14 Surgestures. The videos were grouped into competent and incompetent based on the quantiles of modified global operative assessment of laparoscopic skills (mGOALS). Surgeon-related information, clinical data, and intraoperative events were analyzed. Sixty-three Surgesture features were extracted to develop the surgical skill classification algorithm. The area under the receiver operating characteristic curve of the classification and the top features were evaluated. Results: Correlation analysis revealed that most perioperative factors had no significant correlation with mGOALS scores. The incompetent group has a higher probability of cholecystic vascular injury compared to the competent group (30.8 vs 6.1%, P =0.004). The competent group demonstrated fewer inefficient Surgestures, lower shift frequency, and a larger dissection-exposure ratio of Surgestures during the procedure. The area under the receiver operating characteristic curve of the classification algorithm achieved 0.866. Different Surgesture features contributed variably to overall performance and specific skill items. Conclusion: The computer algorithm accurately classified surgeons with different skill levels using objective Surgesture features, adding insight into designing automatic laparoscopic surgical skill assessment tools with technical feedback.
Surgesture: a novel instrument based on surgical actions for objective skill assessment

Zixin Chen,Jingjing An,Shangdi Wu,Ke Cheng,Jiaying You,Jie Liu,Jingwen Jiang,Dewei Yang,Bing Peng,Xin Wang

DOI: https://doi.org/10.1007/s00464-022-09108-x

Abstract:Background: Due to varied surgical skills and the lack of an efficient rating system, we developed Surgesture based on elementary functional surgical gestures performed by surgeons, which could serve as objective metrics to evaluate surgical performance in laparoscopic cholecystectomy (LC). Methods: We defined 14 LC basic Surgestures. Four surgeons annotated Surgestures among LC videos performed by experts and novices. The counts, durations, average action time, and dissection/exposure ratio (D/E ratio) of LC Surgestures were compared. The phase of mobilizing hepatocystic triangle (MHT) was extracted for skill assessment by three professors using a modified Global Operative Assessment of Laparoscopic Skills (mGOALS). Results: The novice operation time was significantly longer than the expert operation time (58.12 ± 19.23 min vs. 26.66 ± 8.00 min, P < 0.001), particularly during MHT phase. Novices had significantly more Surgestures than experts in both hands (P < 0.05). The left hand and inefficient Surgesture of novices were dramatically more than those of experts (P < 0.05). The experts demonstrated a significantly higher D/E ratio of duration than novices (0.79 ± 0.37 vs. 2.84 ± 1.98, P < 0.001). The counts and time pattern map of LC Surgestures during MHT demonstrated that novices tended to complete LC with more types of Surgestures and spent more time exposing the surgical scene. The performance metrics of LC Surgesture had significant but weak associations with each aspect of mGOALS. Conclusion: The newly constructed Surgestures could serve as accessible and quantifiable metrics for demonstrating the operative pattern and distinguishing surgeons with various skills. The association between Surgestures and Global Rating Scale laid the foundation for establishing a bridge to automated objective surgical skill evaluation.
Objective assessment of skills acquisition during laparoscopic surgery courses

Shah-Jalal Sarker,Muwaffaq Mezeil Telfah,Louisa Onuba,Bijendra P Patel

DOI: https://doi.org/10.1177/1553350612468960

Abstract:Background: The aim of this prospective study is to objectively assess the acquisition of skills of trainees attending laparoscopic surgery courses. Methods: Thirty-four junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate runs of 3-day core skills in laparoscopic surgery course. Nine control trainees were also included who did not attend the course. Three virtual tasks (camera navigation, hand-eye coordination, and 2-handed maneuver) were used from a virtual reality simulator (Simbionix) for assessment. Camera navigation was assessed by completion time and maintenance of horizontal view, whereas the other 2 tasks were assessed by completion time, path length (both hands), and the number of movements (both hands). A composite score of overall performance was calculated by combining all the 12 parameters. Results: The course significantly (P < 0.001) improved 91% of the junior trainees' precourse laparoscopic skills. Around 70% to 85% of the participants had improvement in skills in all the parameters following the course. The significant improvements were seen in 10 out of 12 task-specific parameters (P ≤ .004) except path length of the left hand. No significant improvement in skills was seen in any 1 of the 12 parameters for the control participants except for a slight reduction in performance matrics. Foundation and core trainees had acquired significantly (P = .02) more skills (23% improvement) than the specialist trainees (8% improvement). Overall acquired skills did not differ significantly in terms of age, sex, or dominant hand of trainees. Conclusion: Objective validated methods can be used to demonstrate course efficacy in addition to providing participants with an insight into their skills. Junior trainees with little or no previous experience benefit the most from such courses irrespective of their age, sex, and dominant hand.
Comparison of surgical performance using articulated (ArtiSential®) and conventional instruments for colorectal laparoscopic surgery: A single‐centre, open, before‐and‐after, prospective study

Hye Rim Shin,Heung‐Kwon Oh,Hong‐min Ahn,Tae‐Gyun Lee,Mi Jeoung Choi,Min Hyeong Jo,Anuj Naresh Singhi,Duck‐Woo Kim,Sung‐Bum Kang

DOI: https://doi.org/10.1111/codi.17205

IF: 3.4

2024-10-27

Colorectal Disease

Abstract:Aim Rigid surgical instruments limit movement whereas articulated instruments offer better control in small spaces and allow for intuitive and ergonomic movements. However, the effectiveness of the use of articulated instruments in improving colorectal laparoscopic outcomes remains unclear. The aim of this work was to determine whether colorectal laparoscopic surgical proficiency improved when multijoint instruments were used instead of conventional ones. Method We enrolled 70 consecutive patients (n = 20 for conventional instruments) aged 19–80 years who underwent elective laparoscopic surgery for colorectal diseases. Unedited surgery videos were validated using the modified Global Operative Assessment of Laparoscopic Skills (mGOALS) scale. Learning curves were analysed using a cumulative sum control chart for mGOALS grades. Results The surgery type, length of hospital stay and 30‐day postoperative complication rates were comparable between the groups, and the surgeon's mGOALS grades were similar (p = 0.190). However, in the articulated group, the scores were significantly higher for depth perception (p = 0.012) and tissue‐handling domains (p = 0.046), while surgical duration was significantly shorter and intraoperative blood loss was significantly lower (p = 0.022), compared with those in the conventional (p = 0.002) group. Learning curve findings indicated that the first 10 and subsequent 40 surgeries in the articulated group were within the inexperienced and experienced phases, respectively. The mGOALS score in the experienced phase improved in the articulated group compared with that in the conventional group (p = 0.036). Conclusions The use of articulated instruments in laparoscopic colorectal surgery showed potential benefits. Further studies are needed to confirm these findings.

gastroenterology & hepatology,surgery

Wrist Accelerometer Analysis of Competent Versus Expert Laparoscopic Surgeons

Proficiency assessment of gesture analysis in laparoscopy by means of the surgeon's musculo-skeleton model

Handheld Laparoscopic Robotized Instrument: Progress or Challenge?

Defining the competencies for laparoscopic transabdominal adrenalectomy: An investigation of intraoperative behaviors and decisions of experts

Laparoscopic surgical skill evaluation with motion capture and eyeglass gaze cameras: A pilot study

Comparative Study of the Use of Different Sizes of an Ergonomic Instrument Handle for Laparoscopic Surgery

Using Artificial Intelligence to Gauge Competency on a Novel Laparoscopic Training System

Sensors for expert grip force profiling: towards benchmarking manual control of a robotic device for surgical tool movements

Perceptual impairment and psychomotor control in virtual laparoscopic surgery

Mechanical Evaluation of Articulating Instruments and Cross-Handed Manipulation in Laparoendoscopic Single-Site Surgery

Comparative Study of Ergonomics in Conventional and Robotic-Assisted Laparoscopic Surgery

Skill acquisition and gaze behavior during laparoscopic surgical simulation

Assessing Arthroscopic Skills Using Wireless Elbow-Worn Motion Sensors.

Hand Motion Analysis Using Accelerometer-Based Sensors and Sheep's Head Model for Basic Training in Functional Endoscopic Sinus Surgery

Crossover-effects in technical skills between laparoscopy and robot-assisted surgery

Force-Sensing Enhanced Simulation Environment (forsense) for Laparoscopic Surgery Training and Assessment

Objective classification of psychomotor laparoscopic skills of surgeons based on three different approaches

Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies

Surgesture: a novel instrument based on surgical actions for objective skill assessment

Objective assessment of skills acquisition during laparoscopic surgery courses

Comparison of surgical performance using articulated (ArtiSential®) and conventional instruments for colorectal laparoscopic surgery: A single‐centre, open, before‐and‐after, prospective study