Long-term outcomes of bilateral pallidal stimulation for primary generalised dystonia

Michał Sobstyl,T. Kmieć,M. Ząbek,K. Szczałuba,Z. Mossakowski

DOI: https://doi.org/10.1016/j.clineuro.2014.08.027

2014-11-01

Abstract:

What problem does this paper attempt to address?

Performance in Irish Selection and Future Performance in Surgical Training

Conor Toale,Marie Morris,Sara Gross,Dara A. O’Keeffe,Donncha M. Ryan,Fiona Boland,Eva M. Doherty,Oscar J. Traynor,Dara O. Kavanagh

DOI: https://doi.org/10.1001/jamasurg.2024.0034

2024-03-06

JAMA Surgery

Abstract:Importance Selection processes for surgical training should aim to identify candidates who will become competent independent practitioners and should aspire to high standards of reliability and validity. Objective To determine the association between measured candidate factors at the time of an Irish selection and assessment outcomes in surgical training, examined via rate of progression to Higher Specialist Training (HST), attrition rates, and performance as assessed through a multimodal framework of workplace-based and simulation-based assessments. Design, Setting, and Participants This retrospective observational cohort study included data from all successful applicants to the Royal College of Surgeons in Ireland (RCSI) national Core Surgical Training (CST) program. Participants included all trainees recruited to dedicated postgraduate surgical training from 2016 to 2020. These data were analyzed from July 11, 2016, through July 10, 2022. Exposures Selection decisions were based on a composite score that was derived from technical aptitude assessments, undergraduate academic performance, and a 4-station multiple mini-interview. Main outcomes and measures Assessment data, attrition rates, and rates of progression to HST were recorded for each trainee. CST performance was assessed using workplace-based and simulation-based technical and nontechnical skill assessments. Potential associations between selection and assessment measures were explored using Pearson correlation, logistic regression, and multiple linear-regression analyses. Results Data were available for 303 trainees. Composite scores were positively associated with progression to HST (odds ratio [OR], 1.09; 95% CI, 1.05-1.13). There was a weak positive correlation, ranging from 0.23 to 0.34, between scores and performance across all CST assessments. Multivariable linear regression analysis showed technical aptitude scores at application were associated with future operative performance assessment scores, both in the workplace (β = 0.31; 95% CI, 0.14-0.48) and simulated environments (β = 0.57; 95% CI, 0.33-0.81). There was evidence that the interpersonal skills interview station was associated with future performance in simulated communication skill assessments (β = 0.55; 95% CI, 0.22-0.87). Conclusions and Relevance In this study, performance at the time of Irish national selection, measured across technical and nontechnical domains in a multimodal fashion, was associated with future performance in the workplace and in simulated environments. Future studies will be required to explore the consequential validity of selection, including potential unintended effects of selection and ranking on candidate performance.

surgery
Risk Perception in a Developing Country: The Case of Jordan

Mahmaod Al-Rawad,A. Khattab

DOI: https://doi.org/10.5539/IBR.V8N1P81

2014-12-25

Abstract:Purpose: Recognizing the importance of risk perception and the poor understanding of the phenomenon in developing countries, this study characterizes risk perception in Jordan. Design: A mixed quantitative and qualitative survey approach was adopted. Semi-structured interviews were used to identify risks relevant to Jordanian society, then perceptions of these were examined using a questionnaire. Sampling was stratified by province and convenience sampling was adopted within each stratum. The response rate of 53.6 percent was adequate for accurate and useful results representative of the target population. The questionnaire data were analyzed using parametric statistics including principal component analysis and mean analysis. Findings: A cognitive map shows that Jordanians perceived warfare and terrorist attack as the most dreaded, catastrophic and uncontrollable risks to society. Refugee influx was also perceived as a high risk on the dreaded dimension. Although Jordan generates no nuclear electricity, nuclear power was also loaded high on the dreaded factor, confirming that risk perception can be affected by negative international events. Research Limitations/Implications: A proper interpretation of the cognitive map requires an appreciation of the plasticity of risk, as perceptions are changed by scientific knowledge, media coverage and globalization of risk issues. Future research should examine these changes and determine other possible variables influencing risk ratings at different times. While stratified sampling helped the representativeness of the sample, convenience sampling was applied within each stratum. Future research might use probability sampling instead. This study gives risk analysts and policymakers a basis for understanding and anticipating public responses to risks and improving the communication of risk information among laypeople and decision-makers. Originality: This study is one of few to develop a cognitive map and investigate factors influencing risk perception in Jordan, in the volatile Middle East. Rather than surveying mainly students, it used a representative sample from Jordan’s 12 provinces.
Reliability of a workplace-based assessment for the United States general surgical trainees’ intraoperative performance using multivariate generalizability theory: a psychometric study

Ting Sun,Stella Yun Kim,Brigitte Kristin Smith,Yoon Soo Park

DOI: https://doi.org/10.3352/jeehp.2024.21.26

Abstract:Purpose: The System for Improving and Measuring Procedure Learning (SIMPL), a smartphone-based operative assessment application, was developed to assess the intraoperative performance of surgical residents. This study aims to examine the reliability of the SIMPL assessment and determine the optimal number of procedures for a reliable assessment. Methods: In this retrospective observational study, we analyzed data collected between 2015 and 2023 from 4,616 residents across 94 General Surgery Residency programs in the United States that utilized the SIMPL smartphone application. We employed multivariate generalizability theory and initially conducted generalizability studies to estimate the variance components associated with procedures. We then performed decision studies to estimate the reliability coefficient and the minimum number of procedures required for a reproducible assessment. Results: We estimated that the reliability of the assessment of surgical trainees’ intraoperative autonomy and performance using SIMPL exceeded 0.70. Additionally, the optimal number of procedures required for a reproducible assessment was 10, 17, 15, and 17 for postgraduate year (PGY) 2, PGY 3, PGY 4, and PGY 5, respectively. Notably, the study highlighted that the assessment of residents in their senior years necessitated a larger number of procedures compared to those in their junior years. Conclusion: The study demonstrated that the SIMPL assessment is reliably effective for evaluating the intraoperative performance of surgical trainees. Adjusting the number of procedures based on the trainees’ training stage enhances the assessment process’s accuracy and effectiveness.
[Non-respiratory complications of influenza in infants].

F. Cantarutti,F. Panizon

1955-12-01

Minerva Pediatrica

Abstract:
[Genetic and experimental approach to bony craniofacial growth: the role of the divergent homeobox gene Msx1].

B. Vi-Fane,J. Nefussi,S. Orestes-Cardoso,D. Hotton,B. Robert,C. Chabre,A. Berdal,J. Davideau

DOI: https://doi.org/10.1051/ORTHODFR/200374103

2003-03-01

L Orthodontie Française

Abstract:Tooth agenesis and clef palate are associated to the mutation of the Msx1 homeobox genes, highlighting the pivotal role of homeobox genes during the initial development of the craniofacial skeleton. Msx1 also controls the terminal differentiation of mineralised tissues forming cells. Recently, a Msx1 antisense RNA has been identified which inhibits Msx1 protein expression in odontoblastic cells. In order to investigate the role of Msx1 gene and its antisense RNAs during the late developmental stages of the craniofacial bone formation, the expression pattern of Msx1 protein, sense and antisense transcripts and the aspects of bone growth have been studied in post-natal normal and Msx1 knock-in mutant mice. Msx1 protein was strongly expressed in preosteoblasts of specific bone sites such as the basal mandible. At the same bone sites, bone growth was impaired or markedly decreased in knock-in mice. The comparison between the various expression patterns of Msx1 protein, sense and antisense RNAs suggests that the site-specific action of Msx1 protein on bone growth and craniofacial morphogenesis and that Msx1 protein level could be controlled by the local ratio of Msx1 sense and antisense RNAs. Regarding our experimental data and hypothesis, a clinical study of patients with MSX1 mutation will be performed in order to better characterize the abnormalities of the craniofacial skeleton growth.
Kinematic metrics and surgeon experience in robotic cholecystectomies: a pilot study on breaking down technical performance

Daniel P Bitner,Sarah Choksi,Katherine Carsky,Poppy Addison,Robert Andrews,Rebecca Kowalski,Adin Reisner,Alex Farrell,Kavita Jain,Valery Dronsky,Anthony Jarc,Andrew Yee,Filippo Filicori

DOI: https://doi.org/10.1007/s00464-023-10481-4

Abstract:Background: Recent studies have correlated surgical skill measured by video-based assessment with improved clinical outcomes. Certain automated measures of operative performance in robotic surgery can be gathered beyond video review called objective performance indicators (OPIs). We explore the relationship between OPIs, surgeon experience, and postoperative recovery, hypothesizing that more efficient dissection will be associated with experience. Methods: Fifty-six robotic cholecystectomies between February 2022 and March 2023 were recorded at a large tertiary referral center. Surgeon experience and clinical outcomes data from the EMR were obtained for all 56 cases with 10 completing the QOL survey. Two steps of robotic cholecystectomies were reviewed: dissection of Calot's triangle (DCT) and dissection of the gallbladder from the liver (DGL). Postoperative recovery was measured using the SF-36 well-being survey. Univariate analysis was conducted using Pearson's coefficient. Results: Increased operative experience was associated with more efficient camera and instrument movements. DCT had 7 and DGL had 31 of 41 OPIs that correlated with experience. With respect to DGL, more experienced surgeons had reduced step duration and instrument path length and increased camera and instrument speeds. Conclusions: Several OPIs correlate with surgical experience and may form the basis of more instructive feedback for trainees and less experienced surgeons in improving intraoperative technique.
Distribution of innate psychomotor skills recognized as important for surgical specialization in unconditioned medical undergraduates

Andrea Moglia,Luca Morelli,Vincenzo Ferrari,Mauro Ferrari,Franco Mosca,Alfred Cuschieri

DOI: https://doi.org/10.1007/s00464-018-6146-8

2018-03-14

Surgical Endoscopy

Abstract:BackgroundThere is an increasing interest for a test assessing objectively the innate aptitude for surgery as a craft specialty to complement the current selection process of surgical residents. The aim of this study was to quantify the size of individuals with high, average, and low level of innate psychomotor skills among medical students.MethodsA volunteer sample of 155 medical students, without prior experience with surgical simulator, executed five tasks at a virtual simulator for robot-assisted surgery. They had to reach proficiency twice consecutively in each before moving to the next one. A weighting based on time and number of attempts needed to reach proficiency was assigned to each task.ResultsNine students (5.8%) out of 155 significantly outperformed all the others on median (i.q.r.) weighted time [44.7 (42.2–47.3) min vs. 98.5 (70.8–131.8) min, p < 0.001], and number of attempts to reach proficiency [14 (12–15) vs. 23 (19–32.75), p < 0.001). Seventeen students (11.0%) scored significantly much worse than the rest on median weighted time [202.2 (182.5–221.0) min vs. 84.3 (65.7–114.4) min, p < 0.001], and number of attempts [42 (40–48) vs. 22 (17.25–28), p < 0.001]. Low correlation between simulator scores and extracurricular activities, like videogames and musical instruments, was found.ConclusionsThe test successfully identified two groups straddling the large cohort with average innate aptitude for psychomotor skills: (i) innately gifted and (ii) with scarce level. Hence, exercises on a virtual simulator are a valid test of innate manual dexterity and can be considered to complement the selection process for a surgical training program, primarily to identify individuals with low innate aptitude for surgery and advise them to consider specialization in other (non-craft) medical specialties.
Predicting Resident Competence for Otolaryngology Key Indicator Procedures

Jenny X. Chen,Brian C. George,Stacey T. Gray,Andrew E. Krumm

DOI: https://doi.org/10.1002/lary.30680

2023-03-31

Abstract:Competency‐based surgical education requires practical assessments and meaningful benchmarks. In otolaryngology, key indicator procedure (KIP) minima are tracked as indicators of surgical exposure during training, yet it remains unknown how many times trainees should be evaluated on critical procedures to ensure operative competence. In this study, we used Bayesian mixed effects models to compute predicted performance expectations for KIPs using data gathered from workplace‐based assessments of otolaryngology residents. Objective Competency‐based surgical education requires practical assessments and meaningful benchmarks. In otolaryngology, key indicator procedure (KIP) minima are indicators of surgical exposure during training, yet it remains unknown how many times trainees must be evaluated on KIPs to ensure operative competence. Herein, we used Bayesian mixed effects models to compute predicted performance expectations for KIPs. Methods From November 2017 to September 2021, a smartphone application (SIMPL OR) was used by attendings at five otolaryngology training programs to rate resident operative performance after each case on a five‐level scale. Bayesian mixed effects models were used to estimate the probability that postgraduate year (PGY) 3, 4, or 5 trainees would earn a "practice‐ready" (PR) rating on a subsequent evaluation based on their previously earned PR ratings for each KIP. Probabilities of earning a subsequent PR rating were examined for interpretability, and cross‐validation was used to assess predictive validity. Results A total of 842 assessments of KIPs were submitted by 72 attendings for 92 residents PGY 2–5. The predictive model had an average Area Under the Receiver Operating Curve of 0.77. The number of prior PR ratings that senior residents needed to attain a 95% probability of earning a PR rating on a subsequent evaluation was estimated for each KIP. For example, for mastoidectomies, PGY4 residents needed to earn 10 PR ratings whereas PGY5 residents needed 4 PR ratings on average to have a 95% probability of attaining a PR rating on a subsequent evaluation. Conclusion Predictive modeling can inform assessment benchmarks for competency‐based surgical education. Level of Evidence N/A Laryngoscope, 2023

medicine, research & experimental,otorhinolaryngology
Looking Beyond the Numbers: A Comparison of Operative Self-Efficacy, Supervision, and Case Volume in General Surgery Residency

Rachel M Jensen,Ananya Anand,LaDonna E Kearse,James R Korndorffer Jr

DOI: https://doi.org/10.4300/JGME-D-23-00461.1

Abstract:Background A national survey of general surgery residents revealed significant self-assessed deficits in preparation for independent practice, with only 7.7% of graduating postgraduate year 5 residents (n=1145) reporting self-efficacy for all 10 commonly performed operations surveyed. Objective We sought to understand why this phenomenon occurs. We hypothesized that self-efficacy would be positively correlated with both operative independence and case volume. Methods We compared 3 independent datasets: case information for the same 10 previously surveyed operations for residents graduating in 2020 (dataset 1), operative independence data obtained through the SIMPL OR app, an operative self-assessment tool (dataset 2), and case volume data obtained through the Accreditation Council for Graduate Medical Education National Data Report (dataset 3). Operations were categorized into high, middle (mid), and low self-efficacy tiers; analysis of variance was used to compare operative independence and case volume per tier. Results There were significant differences in self-efficacy between high (87.7%), mid (68.3%), and low (25.4%) tiers (P=.008 [95% CI 6.2, 32.7] for high vs mid, P<.001 for high vs low [49.1, 75.6], and P<.001 for mid vs low [28.7, 57.1]). The percentage of cases completed with operative independence followed similar trends (high 32.7%, mid 13.8%, low 4.9%, P=.006 [6.4, 31.4] for high vs mid, P<.001 [15.3, 40.3] for high vs low, P=.23 [-4.5, 22.3] for mid vs low). The total volume of cases decreased from high to mid to low self-efficacy tiers (average 91.8 to 20.8 to 11.1) but did not reach statistical significance on post-hoc analysis. Conclusions In this analysis of US surgical residents, operative independence was strongly correlated with self-efficacy.
Assessment of Personality, Psychomotor Abilities, Spirituality and Team Work in Surgeons Depending on Experience: a Prospective Pilot Study

Mladenka Vukojević,Arta Dodaj,Ana Zovko,Zdrinko Brekalo,Kristina Galic,Ante Kvesic,Bruno Splavski

DOI: https://doi.org/10.21203/rs.3.rs-108199/v1

2020-11-19

Abstract:Abstract Background: A few studies described surgical personality, inquiring all its dimensions, as well as surgeons’ psychomotor abilities and propensity for teamwork. Even fewer papers examined their spirituality and its impact on the effectiveness of daily surgical labor. The aim of this paper is to evaluate personality traits, psychomotor abilities and spirituality in surgeons and surgical residents, as well as propensity for teamwork in relation to their work experience. Methods: The study involved 15 male surgeons aged 40-49 and 15 male surgical residents aged 30-39, who were divided into the case and control group according to their age. The Eysenck Personality Questionnaire, visual stimulus response rate, oculomotor, and manual ability assessments, movement stability testing, intrinsic/extrinsic religious orientation, and teamwork efficiency questionnaires were used. Results: No statistically significant differences in personality traits, psychomotor abilities, religious orientation, and propensity for teamwork were recorded between surgeons and residents. These may support the specialty choice, and selection of surgical teams helping them to make important professional decisions, which well-affect the patients’ outcome.
Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study

Jenny X Chen,Elliott Kozin,Jordan Bohnen,Brian George,Daniel Deschler,Kevin Emerick,Stacey T Gray

DOI: https://doi.org/10.1002/lio2.323

2019-11-11

Abstract:Background: In the era of duty hour restrictions, otolaryngology residents may not gain the operative experience necessary to function autonomously by the end of training. This study quantifies residents' autonomy during key indicator cases, defined by the Accreditation Council for Graduate Medical Education. Study design: Prospective cohort study. Methods: Faculty and residents at a large academic institution were surveyed on the surgical autonomy trainees should achieve for otolaryngology key indicator surgeries at each training level. Residents and faculty used the mobile application "System for Improving and Measuring Procedural Learning" (SIMPL) between December 2017 and July 2018 to log trainees' operative autonomy during cases on a validated four-level Zwisch scale, from "show and tell" to "supervision only." Results: The study included 40 participants (23 residents and 17 attendings). The survey response rate was 83%. In surveys, residents overestimated the autonomy PGY5 residents should achieve for parotidectomy, rhinoplasty, thyroid/parathyroidectomy, and airway procedures compared with faculty (P < .05). Using SIMPL, 833 evaluations were logged of which 253 were paired evaluations for key indicator cases. Comparing survey predictions with actual cases logged in SIMPL, residents and faculty overestimated the autonomy achieved by senior trainees performing mastoidectomy (PGY5, P < .05) and ethmoidectomy (PGY4/5, P < .05); both felt that senior residents should operate with between "passive help" and "supervision only" whereas residents actually had "passive help." Residents overestimated their autonomy during rhinoplasty (PGY5, P = .017) and parotidectomy (PGY5, P = .007) while attendings accurately expected chief residents to have "passive help." Conclusions: Resident surgical autonomy varies across otolaryngology procedures. Multicenter studies are needed to elucidate national trends. Level of evidence: 2.
Spatial Cognition Ability in Surgeons Performing Endoscopic Endonasal Transsphenoidal Surgery

Juli Yamashita,Takeshi Okuda,Takayuki Tasaki,Jun C Takahashi

DOI: https://doi.org/10.2176/jns-nmc.2024-0080

2024-11-15

Abstract:Endoscopic surgery, including endoscopic endonasal transsphenoidal surgery (ETSS), requires special psychomotor skills from surgeons. The learning curve in the acquisition of psychomotor skills varies among individuals, and studies about laparoscopy indicate that the difference can be predicted using spatial ability tests. We examined the association between the results of such tests and the learning curve in ETSS to determine the need for a personalized curriculum for ETSS skill training. A total of 30 fifth-year medical students from Kindai University School of Medicine (17 men, 13 women; mean age, 26 years) without ETSS experience completed the spatial orientation test (SOT) for the measurement of spatial visualization ability. They performed the dural incision task (DIT) twice on an ETSS training model for surgical psychomotor skill evaluation. The SOT scores (angle errors) exhibited substantial individual differences in spatial visualization ability, whereas the DIT scores significantly improved in the second trial (Wilcoxon signed-rank test, P = 0.0035). However, no significant difference was observed in the DIT scores between the smaller error and larger error groups of the SOT. The results indicated that two DIT trials were sufficient to acquire psychomotor skills for the DIT as the endoscope was almost fixed and learning only one viewpoint and line of sight combination was adequate. In conclusion, a personalized ETSS training program based on the trainee's spatial ability is not necessary for the DIT. Further research is warranted to determine the effect of spatial ability on more complex tasks, such as suturing in cranial base repair.
The use of objective assessments in the evaluation of technical skills in cardiothoracic surgery: a systematic review

Nabil Hussein,Jef Van den Eynde,Connor Callahan,Alvise Guariento,Can Gollmann-Tepeköylü,Malak Elbatarny,Mahmoud Loubani

DOI: https://doi.org/10.1093/icvts/ivac194

2022-07-28

Interactive Cardiovascular and Thoracic Surgery

Abstract:Summary OBJECTIVES With reductions in training time and intraoperative exposure, there is a need for objective assessments to measure trainee progression. This systematic review focuses on the evaluation of trainee technical skill performance using objective assessments in cardiothoracic surgery and its incorporation into training curricula. METHODS Databases (EBSCOHOST, Scopus and Web of Science) and reference lists of relevant articles for studies that incorporated objective assessment of technical skills of trainees/residents in cardiothoracic surgery were included. Data extraction included task performed; assessment setting and tool used; number/level of assessors; study outcome and whether the assessments were incorporated into training curricula. The methodological rigour of the studies was scored using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS Fifty-four studies were included for quantitative synthesis. Six were randomized-controlled trials. Cardiac surgery was the most common speciality utilizing objective assessment methods with coronary anastomosis the most frequently tested task. Likert-based assessment tools were most commonly used (61%). Eighty-five per cent of studies were simulation-based with the rest being intraoperative. Expert surgeons were primarily used for objective assessments (78%) with 46% using blinding. Thirty (56%) studies explored objective changes in technical performance with 97% demonstrating improvement. The other studies were primarily validating assessment tools. Thirty-nine per cent of studies had established these assessment tools into training curricula. The mean ± standard deviation MERSQI score for all studies was 13.6 ± 1.5 demonstrating high validity. CONCLUSIONS Despite validated technical skill assessment tools being available and demonstrating trainee improvement, their regular adoption into training curricula is lacking. There is a need to incorporate these assessments to increase the efficiency and transparency of training programmes for cardiothoracic surgeons.

surgery,cardiac & cardiovascular systems,respiratory system
Surgical Sabermetrics

Emma E Howie,Olivia Ambler,Eilidh Gm Gunn,Roger D Dias,Stephen J Wigmore,Richard Je Skipworth,Steven J Yule,Emma E. Howie,Eilidh GM Gunn,Roger D. Dias,Stephen J. Wigmore,Richard JE Skipworth,Steven J. Yule

DOI: https://doi.org/10.1097/sla.0000000000006211

IF: 13.787

2024-01-23

Annals of Surgery

Abstract:Objective: To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical non-technical skills and investigate the implications for enhancing surgical performance. Background: Surgeons need high-quality, objective, and timely feedback to optimise performance and patient safety. Digital tools to assess non-technical skills have potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons. Methods: A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included “Assessment” “Surgeons” and “Technology”. Eligible studies included digital assessment of non-technical skills for surgeons, residents, and/or medical students within an operative context. Results: From 19,229 articles screened, 81 articles met inclusion criteria. The studies varied in surgical specialities, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least one category of surgical non-technical skill using single(n=54) or multiple objective measures(n=27). The majority of studies utilised simulation(n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load(n=57), situation awareness(n=24), communication(n=3), teamwork(n=13), and leadership(n=2). No studies measured intraoperative decision-making. Conclusions: The literature detailing the intersection between surgical data science and operative non-technical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide holistic assessment of surgical performance.

surgery
Measuring Chief Resident Skill and Entrustment Progression in An Operative Coaching Program: Four Years’ Experience

Michael R Go,Amber L Traugott,Aslam Ejaz,Courtney Collins,Alan E Harzman,E Christopher Ellison,Xiaodong Phoenix Chen,Michael R. Go,Amber L. Traugott,Alan E. Harzman,E. Christopher Ellison,Xiaodong (Phoenix) Chen

DOI: https://doi.org/10.1016/j.jsurg.2023.12.014

IF: 3.524

2024-02-01

Journal of Surgical Education

Abstract:OBJECTIVE: Operative coaching (OC) may facilitate improvement of surgery residents' competencies by optimizing learning and teaching. We investigated how residents' operative skills and prospective entrustment (PE) progress throughout the chief year in our OC program, how OC is perceived by participants, and how OC may facilitate learning and teaching.DESIGN, SETTING, AND PARTICIPANTS: This is a mixed-methods study conducted within the Ohio State University Wexner Medical Center General Surgery residency. Validated performance evaluations with procedural-specific skill, general skill (GS), step-specific guidance required (SSG) (an autonomy measure), and PE measures completed by chiefs, faculty coaches, and attending surgeons from 7/2018 to 6/2022 were reviewed. We also interviewed OC participants to understand their experience. Descriptive statistical and qualitative content analysis were applied.RESULTS: 441 evaluations from 147 OC cases completed by 22 chiefs, 5 faculty coaches, and 24 attendings were included. Overall, resident GS (p = 0.036), SSG (p = 0.023), and PE (p = 0.002) significantly improved throughout the year. PE significantly correlated (all p < 0.0001) with SSG (r = 0.73), followed by procedural-specific skill (r = 0.59), then GS (r = 0.57). On average, chiefs underestimated their surgical skills while attendings overestimated autonomy they permitted to residents. Chiefs, coaches, and attendings reached consensus on chiefs' PE upon graduation. Five graduated chiefs and 5 attendings were interviewed. Chiefs described OC as effective in improving their self-regulated learning and particularly valued 3 OC elements: neutral authentic feedback, third-party real-time observation, and actionable feedback. Attendings noted OC promoted their engagement in skills assessment and teaching.CONCLUSIONS: Our findings suggest chief residents' skills, autonomy, and PE progress steadily along their OC journey. Despite differences in residents', coaches', and attendings' perceptions of skill, measures of autonomy reliably correlate with entrustment. OC promotes resident learning, faculty teaching, and assessment of resident skills, autonomy, and PE in the OR.

surgery,education, scientific disciplines
92 Teleneuropsychological Evaluation of Bariatric Surgery Candidates: Cognitive Profiles and Recommendations for Future Practice

Madeline Uretsky,Hayden Ferguson,Serena Mainiero,Irene Piryatinsky,Maxine Krengel

DOI: https://doi.org/10.1017/s1355617723006409

2023-11-01

Journal of the International Neuropsychological Society

Abstract:Objective: Vascular complications, including elevated body mass index (BMI), are known risk factors for cognitive impairment. Obtaining a cognitive baseline is commonplace in pre-surgical protocols, including for Parkinson’s disease and epilepsy. Currently, routine evaluations for bariatric surgery candidates do not include neuropsychological assessment. This setting provides a unique opportunity to identify cognitive profiles of younger individuals at risk for cognitive impairment. Here, we argue for the standard implementation of a brief, online cognitive battery via telemedicine, to enhance existing protocols of bariatric pre-surgical evaluations. Participants and Methods: Nineteen bariatric surgery candidates were referred to a private neuropsychological assessment practice for pre-surgical cognitive/psychological evaluation. Assessments were conducted by a neuropsychologist and a psychology graduate student, via remote video conferencing, between April 2020 and June 2022. Candidates completed a clinical interview, intake form, and the Behavior Rating Inventory of Executive Function for Adults (BRIEF-A), and were administered a battery of cognitive measures: Wechsler Test of Adult Reading (WTAR), Hopkins Verbal Learning Test-Revised (HVLT-R); and select subtests from the TestMyBrain Digital Neuropsychology Toolkit: Trail Making Tests A and B (TMT-A/B), Matrix Reasoning (MR), Digit Span Forward and Backward (DSF, DSB), Gradual Onset Continuous Performance Test (CPT), and Simple and Choice Reaction Time (SRT, CRT). Descriptive statistics were conducted to analyze sample demographics. Raw scores on cognitive measures were converted to z-scores and averaged across the sample. Results: The average age at evaluation was 38.2 (9.6) years and average pre-surgical BMI was 46.6k/m2 (9.3), indicating morbid obesity (BMI>40k/ m2). Ten (52.6%) candidates identified as female, 10 (52.6%) identified as White, 8 (42.1%) had 12 years of education or less, 4 (21.1%) were unemployed, and 9 (47.4%) had comorbid psychiatric diagnoses. BRIEF-A sub-scales were within the average range (T’s= 47.9 - 52.9, SD’s [10.1 - 12.8]). Estimated premorbid IQ was average at 102.7 (11.4). Neuropsychological data revealed group performance within the average range on DSF and DSB (z’s= 0.00), TMT-A (z= -0.16), MR (z= -0.53), CPT (z= -0.39), and HVLT-R False Positives (z= 0.05) and Recognition Discriminability (z= -0.44). SRT (z= -0.70), CRT Accuracy (z= -1.37), TMT-B (z= -0.79), HVLT-R Total Recall and Percent Retained (z’s= -0.88), and Delayed Recall and True Positives (z’s= -1.27) were low average. Conclusions: In this sample of pre-surgical bariatric candidates with average intelligence, baseline evaluations revealed mild deficits in reaction time accuracy, visual motoric set-shifting, and verbal learning/memory. These deficits may be the result of microvascular changes in the brain secondary to physical compromise. Results provide additional insight into potential early-onset executive dysfunction, psychomotor slowing, and verbal learning/memory difficulties. In addition to these relative areas of neuropsychological weakness, candidates demonstrated relative strengths in attention, working memory, and visuospatial functioning. These insights provide pre-surgical evaluators with additional information to tailor recommendations and treatment approaches that foster surgical success. With a remote, concise, easy-to-administer battery of tests, routine neuropsychological assessment for bariatric surgery candidates is both a feasible and a useful tool for identifying areas of cognitive strengths and weaknesses. Documenting a patients’ cognitive baseline can assist with monitoring long-term vascular risk-factors and potential cognitive impairment.

psychology,clinical neurology,psychiatry,neurosciences
Anticipation, teamwork and cognitive load: chasing efficiency during robot-assisted surgery

Kevin Sexton,Amanda Johnson,Amanda Gotsch,Ahmed A Hussein,Lora Cavuoto,Khurshid A Guru

DOI: https://doi.org/10.1136/bmjqs-2017-006701

2017-07-08

Abstract:Introduction Robot-assisted surgery (RAS) has changed the traditional operating room (OR), occupying more space with equipment and isolating console surgeons away from the patients and their team. We aimed to evaluate how anticipation of surgical steps and familiarity between team members impacted efficiency. Methods We analysed recordings (video and audio) of 12 robot-assisted radical prostatectomies. Any requests between surgeon and the team members were documented and classified by personnel, equipment type, mode of communication, level of inconvenience in fulfilling the request and anticipation. Surgical team members completed questionnaires assessing team familiarity and cognitive load (National Aeronautics and Space Administration – Task Load Index). Predictors of team efficiency were assessed using Pearson correlation and stepwise linear regression. Results 1330 requests were documented, of which 413 (31%) were anticipated. Anticipation correlated negatively with operative time, resulting in overall 8% reduction of OR time. Team familiarity negatively correlated with inconveniences. Anticipation ratio, per cent of requests that were non-verbal and total request duration were significantly correlated with the console surgeons’ cognitive load (r=0.77, p=0.006; r=0.63, p=0.04; and r=0.70, p=0.02, respectively). Conclusions Anticipation and active engagement by the surgical team resulted in shorter operative time, and higher familiarity scores were associated with fewer inconveniences. Less anticipation and non-verbal requests were also associated with lower cognitive load for the console surgeon. Training efforts to increase anticipation and team familiarity can improve team efficiency during RAS.

health care sciences & services,health policy & services
Expanded Access to Video-Based Laparoscopic Skills Assessments: Ease, Reliability, and Accuracy

Sarah Lund,Sergio Navarro,Jonathan D. D'Angelo,Yoon Soo Park,Mariela Rivera

DOI: https://doi.org/10.1016/j.jsurg.2024.03.010

IF: 3.524

2024-04-26

Journal of Surgical Education

Abstract:OBJECTIVE Video-based performance assessments provide essential feedback to surgical residents, but in-person and remote video-based assessment by trained proctors incurs significant cost. We aimed to determine the reliability, accuracy, and difficulty of untrained attending staff surgeon raters completing video-based assessments of a basic laparoscopic skill. Secondarily, we aimed to compare reliability and accuracy between 2 different types of assessment tools. DESIGN An anonymous survey was distributed electronically to surgical attendings via a national organizational listserv. Survey items included demographics, rating of video-based assessment experience (1 = have never completed video-based assessments, 5 = often complete video-based assessments), and rating of favorability toward video-based and in-person assessments (0 = not favorable, 100 = favorable). Participants watched 2 laparoscopic peg transfer performances, then rated each performance using an Objective Structured Assessment of Technical Skill (OSATS) form and the McGill Inanimate System for Training and Evaluation of Laparoscopic Skills (MISTELS). Participants then rated assessment completion ease (1 = Very Easy, 5 = Very Difficult). SETTING National survey of practicing surgeons. PARTICIPANTS Sixty-one surgery attendings with experience in laparoscopic surgery from 10 institutions participated as untrained raters. Six experienced laparoscopic skills proctors participated as expert raters. RESULTS Inter-rater reliability was substantial for both OSATS (k = 0.75) and MISTELS (k = 0.85). MISTELS accuracy was significantly higher than that of OSATS (κ: MISTELS = 0.18, 95%CI = [0.06,0.29]; OSATS = 0.02, 95%CI = [-0.01,0.04]). While participants were inexperienced with completing video-based assessments (median = 1/5), they perceived video-based assessments favorably (mean = 73.4) and felt assessment completion was "Easy" on average. CONCLUSIONS We demonstrate that faculty raters untrained in simulation-based assessments can successfully complete video-based assessments of basic laparoscopic skills with substantial inter-rater reliability without marked difficulty. These findings suggest an opportunity to increase access to feedback for trainees using video-based assessment of fundamental skills in laparoscopic surgery.

surgery,education, scientific disciplines
Predicting Laparoscopic Surgical Skills of Trainees with Eye Metrics Associated with Focused Attention and Workload

Shiyu Deng,Tianzi Wang,Jacob Hartman-Kenzler,Sarah Henrickson Parker,Shawn D. Safford,Laura E. Barnes,Nathan Lau

DOI: https://doi.org/10.1177/1071181322661156

2022-09-01

Proceedings of the Human Factors and Ergonomics Society Annual Meeting

Abstract:Eye metrics are effective indicators of focused visual attention and perceived workload that have been used to differentiate surgical expertise and task difficulties. However, the change in eye metrics throughout surgical training in a cohort of trainees is under-investigated. This study collected eye-tracking data from 13 medical students practicing the peg transfer task until reaching the passing criteria of the Fundamentals of Laparoscopic Surgery. Six eye metrics measuring focused visual attention and workload were computed and then used in multiple linear regression analysis to predict trial completion time. All predictors were significant in the regression model, collectively explaining 61.7% of the variance in log-transformed completion time. Fixation rates and gaze entropy were the most important metrics at revealing skill acquisition as medical students self-train on the peg-transfer task. The results on these eye metrics demonstrate potential in assessing surgeons-in-training and providing feedback to ensure surgical competency.

English Else
Surgical skill simulation training to proficiency reduces procedural errors among novice cardiac device implanters: a randomized study

Jorio Mascheroni,Martin Stockburger,Ashish Patwala,Lluís Mont,Archana Rao,Hartwig Retzlaff,Christophe Garweg,Anthony G Gallagher,Tom Verbelen

DOI: https://doi.org/10.1093/europace/euae229

2024-08-30

Abstract:Aims: In cardiac device implantation, having both surgical skills and ability to manipulate catheter/lead/wire is crucial. Few cardiologists, however, receive formal surgical training prior to implanting. Skills are mostly acquired directly on-the-job and surgical technique varies across institutions; suboptimal approaches may increase complications. We investigated how novel proficiency-based progression (PBP) simulation training impacts the surgical quality of implantations, compared to traditional simulation (SIM) training. Methods and results: In this international prospective study, novice implanters were randomized (blinded) 1:1 to participate in a simulation-based procedure training curriculum, with proficiency demonstration requirements for advancing (PBP approach) or without (SIM). Ultimately, trainees performed the surgical tasks of an implant on a porcine tissue that was video-recorded and then scored by two independent assessors (blinded to group), using previously validated performance metrics. Primary outcomes were the number of procedural Steps Completed, Critical Errors, Errors (non-critical), and All Errors Combined. Thirty novice implanters from 10 countries participated. Baseline experiences were similar between groups. Compared to SIM-trained, the PBP-trained group completed on average 11% more procedural Steps (P < 0.001) and made 61.2% fewer Critical Errors (P < 0.001), 57.1% fewer Errors (P = 0.140), and 60.7% fewer All Errors Combined (P = 0.001); 11/15 (73%) PBP trainees demonstrated the predefined target performance level vs. 3/15 SIM trainees (20%) in the video-recorded performance. Conclusion: Proficiency-based progression training produces superior objectively assessed novice operators' surgical performance in device implantation compared with traditional (simulation) training. Systematic PBP incorporation into formal academic surgical skills training is recommended before in vivo device practice. Future studies will quantify PBP training's effect on surgery-related device complications.

Long-term outcomes of bilateral pallidal stimulation for primary generalised dystonia

Performance in Irish Selection and Future Performance in Surgical Training

Risk Perception in a Developing Country: The Case of Jordan

Reliability of a workplace-based assessment for the United States general surgical trainees’ intraoperative performance using multivariate generalizability theory: a psychometric study

[Non-respiratory complications of influenza in infants].

[Genetic and experimental approach to bony craniofacial growth: the role of the divergent homeobox gene Msx1].

Kinematic metrics and surgeon experience in robotic cholecystectomies: a pilot study on breaking down technical performance

Distribution of innate psychomotor skills recognized as important for surgical specialization in unconditioned medical undergraduates

Predicting Resident Competence for Otolaryngology Key Indicator Procedures

Looking Beyond the Numbers: A Comparison of Operative Self-Efficacy, Supervision, and Case Volume in General Surgery Residency

Assessment of Personality, Psychomotor Abilities, Spirituality and Team Work in Surgeons Depending on Experience: a Prospective Pilot Study

Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study

Spatial Cognition Ability in Surgeons Performing Endoscopic Endonasal Transsphenoidal Surgery

The use of objective assessments in the evaluation of technical skills in cardiothoracic surgery: a systematic review

Surgical Sabermetrics

Measuring Chief Resident Skill and Entrustment Progression in An Operative Coaching Program: Four Years’ Experience

92 Teleneuropsychological Evaluation of Bariatric Surgery Candidates: Cognitive Profiles and Recommendations for Future Practice

Anticipation, teamwork and cognitive load: chasing efficiency during robot-assisted surgery

Expanded Access to Video-Based Laparoscopic Skills Assessments: Ease, Reliability, and Accuracy

Predicting Laparoscopic Surgical Skills of Trainees with Eye Metrics Associated with Focused Attention and Workload

Surgical skill simulation training to proficiency reduces procedural errors among novice cardiac device implanters: a randomized study