Practical Guide to Pragmatic Clinical Trials in Surgical Education Research

Karl Y. Bilimoria,Jason S. Haukoos,Gerard M. Doherty

DOI: https://doi.org/10.1001/jamasurg.2023.6690

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods provides an overview of the key features of pragmatic trials within the context of surgical education research using examples from the Flexibility in Duty-Hour Requirements for Surgical Trainees trial.

surgery

What problem does this paper attempt to address?

Practical Guide to Experimental and Quasi-Experimental Research in Surgical Education

Roy Phitayakorn,Todd A. Schwartz,Gerard M. Doherty

DOI: https://doi.org/10.1001/jamasurg.2023.6693

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods describes the methods and pitfalls of experimental and quasi-experimental study designs in surgical education.

surgery
Practical Guide to Ethics in Surgical Education Research

Michael M. Awad,Amy H. Kaji,Timothy M. Pawlik

DOI: https://doi.org/10.1001/jamasurg.2023.6705

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods describes ethical considerations when a study population includes learner participants.

surgery
Practical Guide to Survey Research in Surgical Education

Adnan A. Alseidi,Jason S. Haukoos,Christian de Virgilio

DOI: https://doi.org/10.1001/jamasurg.2023.6678

2024-03-14

JAMA Surgery

Abstract:This Guide to Statistics and Methods describes aspects of methods of survey research in surgical education, important considerations, and pitfalls and limitations.

surgery
Practical Guide to Qualitative Research in Surgical Education

Gurjit Sandhu,Amy H. Kaji,Amalia Cochran

DOI: https://doi.org/10.1001/jamasurg.2023.6681

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods provides an overview of the selection and application of qualitative research in surgical education.

surgery
Practical Guide to Surgical Simulation Research

Aimee K. Gardner,Amy H. Kaji,Marja Boermeester

DOI: https://doi.org/10.1001/jamasurg.2023.6684

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods provides an overview of simulation-based education and its impact on surgeon performance.

surgery
Practical Guide to Common Flaws With Surgical Education Research

Dimitrios Stefanidis,Laura Torbeck,Amy H. Kaji

DOI: https://doi.org/10.1001/jamasurg.2023.6675

2024-03-14

JAMA Surgery

Abstract:This Guide to Statistics and Methods provides an overview of common flaws with surgical education research, including how to recognize and avoid them.

surgery
Practical Guide to Assessment Tool Development for Surgical Education Research

Mohsen M. Shabahang,Todd A. Schwartz,Liane S. Feldman

DOI: https://doi.org/10.1001/jamasurg.2023.6696

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods describes the process of validation and gathering validity evidence for assessment tool development for surgical education research.

surgery
Practical trials in medical education: linking theory, practice and decision making

Martin G Tolsgaard,Kulamakan M Kulasegaram,Charlotte Ringsted

DOI: https://doi.org/10.1111/medu.13135

Abstract:Context: Concerns have been raised over the gap between education theory and practice and how research can contribute to inform decision makers on their choices and priorities. Little is known about how educational theories and research outcomes produced under optimal conditions in highly controlled settings generalise to the real-life education context. One way of bridging this gap is applying the concept of practical trials in medical education. In this paper we elaborate on characteristics of practical trials and based on examples from medical education we discuss the challenges, limitations and future directions for this kind of research. Current state: Practical trials have the overall aim of informing decision makers. They are carried out in real-life settings and are characterised by (i) comparison of viable alternative education strategies, (ii) broad inclusion criteria regarding participants across several settings and (iii) multiple outcome measures with long-term follow-up to evaluate both benefits and risks. Questions posed by practical trials may be proactive in applying theory in the development of educational innovations or reactive to educational reforms and innovations. Non-inferiority or equivalence designs are recommended when comparing viable alternatives and the use of crossover designs, cluster randomisation or stepped wedge trial designs are feasible when studying implementations across several settings. Outcome measures may include variables related to learners, teachers, educational administration, quality of care, patient outcomes and cost. Conclusions: Practical trials in medical education may contribute to bridge the gap between education theory and practice and aid decision makers in making evidence-based choices and priorities. Conducting practical trials is not without challenges and rigorous design and methods must be applied. Of concern is that the practical focus may lead to failure to include a sound theoretical basis in the research questions and the interventions studied, and that authors fail to obtain informed consent from their participants.
Practical Guide to Education Program Evaluation Research

Marc de Moya,Jason S. Haukoos,Kamal M. F. Itani

DOI: https://doi.org/10.1001/jamasurg.2023.6702

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods describes common methods for building evidence of validity for a program within health professional education and provides a framework for program evaluation.

surgery
Practical Guide to Machine Learning and Artificial Intelligence in Surgical Education Research

Daniel A. Hashimoto,Julian Varas,Todd A. Schwartz

DOI: https://doi.org/10.1001/jamasurg.2023.6687

2024-01-03

JAMA Surgery

Abstract:This Guide to Statistics and Methods gives an overview of artificial intelligence techniques and tools in surgical education research.

surgery
Pragmatism in Pediatric Neurosurgery: More Than a Pipe Dream? A Systematic Literature Review and Analysis

Charlotte C Kik,Jochem K H Spoor

DOI: https://doi.org/10.1016/j.wneu.2021.09.124

Abstract:Background: Classic randomized controlled trials (RCTs) form the cornerstone for medical guidelines and protocols. However, in neurosurgery, RCTs are not always applicable to everyday clinical practice. Pragmatic controlled trials aim to incorporate real-life data with the preservation of the methodologic quality. This study is a systematic literature review of all pediatric neurosurgical RCTs published between 2000 and 2020 and an analysis of their pragmatism. Methods: An electronic database search was performed in PubMed, EMBASE, and the Cochrane Library to identify all relevant trials. Pragmatism was evaluated retrospectively on 9 domains: eligibility, recruitment, setting, organization, flexibility (delivery and adherence), follow-up, primary outcome, and primary analysis. Results: Of the 1862 studies included, 15 met the inclusion criteria. On average, studies scored between equally pragmatic/explanatory and rather pragmatic (M = 3.59, standard deviation [SD] = 0.56). Lowest ratings were seen for setting (M = 2.80, SD = 1.66) and eligibility (M = 3.20, SD = 1.66). Highest scores of pragmatism were given to analysis (M = 4.67, SD = 0.82) and intervention organization (M = 4.60, SD = 1.06). There was no significant difference between studies based on number of patients included, main subject, or publication year. Conclusions: Pediatric neurosurgical RCTs scored reasonably well on overall pragmatism. In the future, there will be a greater need for pragmatic controlled trials in pediatric neurosurgery to bridge the divide between real-life data and reliable methodological quality. There is an opportunity to develop further applications of pragmatism tailored to surgical interventions.
A review of pragmatic trials found a high degree of diversity in design and scope, deficiencies in reporting and trial registry data, and poor indexing

Kelly Carroll,Spencer Phillips Hey,Merrick Zwarenstein,Jennifer Zhe Zhang,Hayden P Nix,Steve McDonald,Charles Weijer,Dean A Fergusson,Monica Taljaard,Stuart G. Nicholls,Jamie C. Brehaut,Joanne E. McKenzie

DOI: https://doi.org/10.1016/j.jclinepi.2021.03.021

IF: 7.407

2021-09-01

Journal of Clinical Epidemiology

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective</h3><p>We established a large database of trials to serve as a resource for future methodological and ethical analyses. Here, we use meta-data to describe the broad landscape of pragmatic trials including research areas, identification as pragmatic, quality of trial registry data and enrolment.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Study Design and Setting</h3><p>Trials were identified by a validated search filter and included if a primary report of a health-related randomized trial published January 2014-April 2019. Data were collated from MEDLINE, Web of Science, ClinicalTrials.gov, and full text.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>4337 eligible trials were identified from 13,065 records, of which 1988 were registered in ClinicalTrials.gov. Research areas were diverse, with the most common being general and internal medicine; public, environmental and occupational health; and health care sciences and services. The term "pragmatic" was seldom used in titles or abstracts. Several domains in ClinicalTrials.gov had questionable data quality. We estimated that one-fifth of trials under-accrued by at least 15%.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>There is a need to improve reporting of pragmatic trials and quality of trial registry data. Under accrual remains a challenge in pragmatic RCTs despite calls for more streamlined recruitment approaches. The diversity of pragmatic trials should be reflected in future ethical analyses.</p>

public, environmental & occupational health,health care sciences & services
["Practical clinical competence" - a joint programme to improve training in surgery]

M Ruesseler,A Schill,T Stibane,A Damanakis,I Schleicher,S Menzler,A Braunbeck,F Walcher

DOI: https://doi.org/10.1055/s-0032-1328180

Abstract:Introduction: Practical clinical competence is, as a result of the complexity of the required skills and the immediate consequences of their insufficient mastery, fundamentally important for undergraduate medical education. However, in the daily clinical routine, undergraduate training competes with patient care and experimental research, mostly to the disadvantage of the training of clinical skills and competencies. All students have to spend long periods in compulsory surgical training courses during their undergraduate studies. Thus, surgical undergraduate training is predestined to exemplarily develop, analyse and implement a training concept comprising defined learning objectives, elaborated teaching materials, analysed teaching methods, as well as objective and reliable assessment methods. The project: The aim of this project is to improve and strengthen undergraduate training in practical clinical skills and competencies. The project is funded by the German Federal Ministry of Education and Research with almost two million Euro as a joint research project of the medical faculties of the universities of Frankfurt/Main, Gießen and Marburg, in collaboration with the German Society of Surgery, the German Society of Medical Education and the German Medical Students' Association. Nine packages in three pillars are combined in order to improve undergraduate medical training on a methodical, didactic and curricular level in a nation-wide network. Each partner of this network provides a systematic contribution to the project based on individual experience and competence. Based on the learning objectives, which were defined by the working group "Education" of the German Society of Surgery, teaching contents will be analysed with respect to their quality and will be available for both teachers and students as mobile learning tool (first pillar). The existing surgical curricula at the cooperating medical faculties will be analysed and teaching methods as well as assessment methods for clinical skills will be evaluated regarding their methodological quality and evidence. The existing surgical curricula will be revised and adapted on the basis of these results (second pillar). Qualification programmes for physicians will be implemented in order to improve both undergraduate education and the attractiveness of educational research, the required teaching quality will be imparted in a nationwide "train-the-teacher" program for surgical clinical skills (third pillar).
Praxis-Informed Pointers: A Student Guide for Optimizing Clinical Learning in a Resource-Constrained Setting

E Archer,L Govender,R Meyer,A A Nadkar,L Smit

DOI: https://doi.org/10.1080/10401334.2023.2237480

Abstract:Issue: Health professions education (HPE) is intimately linked with teaching and learning in the clinical environment. While the value of authentic clinical experiences is acknowledged, whether learning actually occurs is to a large extent dependent on students' behaviors and attitudes. The kinds of student behaviors and attitudes that are necessary to optimize learning in the clinical environment thus becomes relevant. Evidence: Tips and recommendations to maximize clinical learning in a variety of settings have been well documented. There is, however, a dearth of literature which takes a narrative-based praxis approach focused on resource-constrained environments. We developed this praxis-orientated article as a means to translate the available literature and theory into a simple, practical guide, focused on optimizing clinical learning from a student perspective, remaining cognizant of the particular challenges present in a resource-constrained setting. Implications: Based on the resource-constrained environments our students are exposed to, we outline the following six key aspects: student-driven learning, integration into the community of practice, student engagement, empathy, interprofessional learning opportunities, and feedback for learning. These aspects provide useful pointers for students in general. Furthermore, exploration into what strategies students may utilize in resource-constrained clinical contexts is addressed.
Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory

Kevin P Weinfurt,Adrian F Hernandez,Gloria D Coronado,Lynn L DeBar,Laura M Dember,Beverly B Green,Patrick J Heagerty,Susan S Huang,Kathryn T James,Jeffrey G Jarvik,Eric B Larson,Vincent Mor,Richard Platt,Gary E Rosenthal,Edward J Septimus,Gregory E Simon,Karen L Staman,Jeremy Sugarman,Miguel Vazquez,Douglas Zatzick,Lesley H Curtis

DOI: https://doi.org/10.1186/s12874-017-0420-7

2017-09-18

Abstract:Background: The clinical research enterprise is not producing the evidence decision makers arguably need in a timely and cost effective manner; research currently involves the use of labor-intensive parallel systems that are separate from clinical care. The emergence of pragmatic clinical trials (PCTs) poses a possible solution: these large-scale trials are embedded within routine clinical care and often involve cluster randomization of hospitals, clinics, primary care providers, etc. Interventions can be implemented by health system personnel through usual communication channels and quality improvement infrastructure, and data collected as part of routine clinical care. However, experience with these trials is nascent and best practices regarding design operational, analytic, and reporting methodologies are undeveloped. Methods: To strengthen the national capacity to implement cost-effective, large-scale PCTs, the Common Fund of the National Institutes of Health created the Health Care Systems Research Collaboratory (Collaboratory) to support the design, execution, and dissemination of a series of demonstration projects using a pragmatic research design. Results: In this article, we will describe the Collaboratory, highlight some of the challenges encountered and solutions developed thus far, and discuss remaining barriers and opportunities for large-scale evidence generation using PCTs. Conclusion: A planning phase is critical, and even with careful planning, new challenges arise during execution; comparisons between arms can be complicated by unanticipated changes. Early and ongoing engagement with both health care system leaders and front-line clinicians is critical for success. There is also marked uncertainty when applying existing ethical and regulatory frameworks to PCTS, and using existing electronic health records for data capture adds complexity.
A Randomized Crossover Trial Evaluating the Impact of Cultural Dexterity Training on Surgical Residents’ Knowledge, Cross-Cultural Care, Skills, and Beliefs

Douglas S. Smink,Gezzer Ortega,Brittany M. Dacier,Emil R. Petrusa,Yu-Jen Chen,Namra Q. Shaikh,Benjamin G. Allar,Maria B.J. Chun,Alexander R. Green,Katharine E. Caldwell,Rachel B. Atkinson,Emma Reidy,Olubode A. Olufajo,L.D. Britt,Molly A. Brittain,Jorge Zárate Rodriguez,Sandra M. Swoboda,Edward E. Cornwell,Kenneth A. Lynch,Paul E. Wise,David T. Harrington,Tara S. Kent,John T. Mullen,Pamela A. Lipsett,Adil H. Haider,

DOI: https://doi.org/10.1097/sla.0000000000006408

IF: 13.787

2024-06-26

Annals of Surgery

Abstract:Objectives: This trial examines the impact of the Provider Awareness and Cultural dexterity Toolkit for Surgeons (PACTS) curriculum on surgical residents’ knowledge, cross-cultural care, skills, and beliefs. Summary Background Data: Cross-cultural training of providers may reduce healthcare outcome disparities, but its effectiveness in surgical trainees is unknown. Methods: PACTS focuses on developing skills needed for building trust, working with patients with limited English proficiency, optimizing informed consent, and managing pain. The PACTS trial was a randomized crossover trial of 8 academic general surgery programs in the United States: The Early group (“Early”) received PACTS between Periods 1 and 2, while the Delayed group (“Delayed”) received PACTS between Periods 2 and 3. Residents were assessed pre- and post-intervention on Knowledge, Cross-Cultural Care, Self-Assessed Skills, and Beliefs. Chi-square and Fisher’s exact tests were conducted to evaluate within- and between-intervention group differences. Results: Of 406 residents enrolled, 315 were exposed to the complete PACTS curriculum. Early residents’ Cross-Cultural Care (79.6% to 88.2%, P <0.0001), Self-Assessed Skills (74.5% to 85.0%, P <0.0001), and Beliefs (89.6% to 92.4%, P =0.0028) improved after PACTS; Knowledge scores (71.3% to 74.3%, P =0.0661) were unchanged. Delayed resident scores pre- to post-PACTS showed minimal improvements in all domains. When comparing the two groups at Period 2, Early residents had modest improvement in all 4 assessment areas, with statistically significant increase in Beliefs (92.4% vs 89.9%, P =0.0199). Conclusion: The PACTS curriculum is a comprehensive tool that improved surgical residents’ knowledge, preparedness, skills, and beliefs, which will help with caring for diverse patient populations.

surgery
Impact of laparoscopic training course for surgical trainees based on an evidence-based pedagogical framework: randomized trial

Ruijun Pan,Xueliang Zhou,Chao Wu,Luyang Zhang,Jiayu Wang,Minhua Zheng,Ting Shi,Wei Cai,Jing Sun

DOI: https://doi.org/10.1093/bjsopen/zrae109

2024-09-03

BJS Open

Abstract:Background: The 'Learn, See, Practice, Prove, Do, Maintain' (LSPPDM) pedagogical framework is an evidence-based framework developed through a careful review and synthesis of the literature. The purpose of the study was to explore the effectiveness and applicability of the LSPPDM pedagogical framework in the laparoscopic training course for surgical residents. Methods: Prospective study of surgical residents who underwent standardized surgical residency training in a single institution from December 2020 to December 2022. Trainees were randomized to either the pedagogical group (6-step LSPPDM pedagogical framework) or traditional group (2-step traditional approach with twice-weekly lectures and a weekly laparoscopic operating skills session). The Global Operative Assessment of Laparoscopic Skills scale was used for technical skills, and the Non-Technical Skills for Surgeons assessment form was used for non-technical skills. Results: Sixty trainees were randomized. The pedagogical group scored higher on subjective perception (P < 0.050) and the theoretical assessment (mean(s.d.) 41.83(6.66)) than those in the traditional group (37.83(5.77)) (P = 0.016). Trainees in the pedagogical group took less time to complete the assessment of models, had fewer failures and higher scores, took less time to complete laparoscopic sutures and knots, showed better proficiency with laparoscopic instruments, and completed at higher quality (P < 0.050). Trainees performing laparoscopic cholecystectomy in animal models demonstrated higher technical and non-technical skill scores in the pedagogical group (P < 0.050). 'Tissue handling' and 'Decision making' were common areas for improvement for both groups of trainees. Conclusions: The LSPPDM pedagogical framework is feasible and demonstrated improvements in technical and non-technical skills in surgical trainees compared to a traditional training programme.
Teaching Basic Surgical Skills Using a More Frugal, Near-Peer, and Environmentally Sustainable Way: Mixed Methods Study

Ben Smith,Christopher Paton,Prashanth Ramaraj

DOI: https://doi.org/10.2196/50212

2023-11-15

Abstract:Background: The Royal College of Surgeons Basic Surgical Skills (BSS) course is ubiquitous among UK surgical trainees but is geographically limited and costly. The COVID-19 pandemic has reduced training quality. Surveys illustrate reduced logbook completion and increased trainee attrition. Local, peer-led teaching has been shown to be effective at increasing confidence in surgical skills in a cost-effective manner. Qualitative data on trainee well-being, recruitment, and retention are lacking. Objective: This study aims to evaluate the impact of a novel program of weekly, lunchtime BSS sessions on both quantitative and qualitative factors. Methods: A weekly, lunchtime BSS course was designed to achieve the outcomes of the Royal College of Surgeons BSS course over a 16-week period overlapping with 1 foundation doctor rotation. All health care workers at the study center were eligible to participate. The study was advertised via the weekly, trust-wide information email. Course sessions included knot tying, suturing, abscess incision and drainage, fracture fixation with application of plaster of Paris, joint aspirations and reductions, abdominal wall closure, and basic laparoscopic skills. The hospital canteen sourced unwanted pig skin from the local butcher for suturing sessions and pork belly for abscess and abdominal wall closure sessions. Out-of-date surgical equipment was used. This concurrent, nested, mixed methods study involved descriptive analysis of perceived improvement scores in each surgical skill before and after each session, over 4 iterations of the course (May 2021 to August 2022). After the sessions, students completed a voluntary web-based feedback form scoring presession and postsession confidence levels on a 5-point Likert scale. Qualitative thematic analysis of voluntary semistructured student interview transcripts was also performed to understand the impact of a free-to-attend, local, weekly, near-peer teaching course on perceived well-being, quality of training, and interest in a surgical career. Students consented to the use of feedback and interview data for this study. Ethics approval was requested but deemed not necessary by the study center's ethics committee. Results: There were 64 responses. Confidence was significantly improved from 47% to 73% (95% CI 15%-27%; P<.001; t13=5.3117) across all surgical skills over 4 iterations. Among the 7 semistructured interviews, 100% (7/7) of the participants reported improved perceived well-being, value added to training, and positivity toward near-peer teaching and 71% (5/7) preferred local weekly teaching. Interest in a surgical career was unchanged. Conclusions: This course was feasible around clinical workloads, resourced locally at next to no cost, environmentally sustainable, and free to attend. The course offered junior doctors not only a weekly opportunity to learn but also to teach. Peer-led, decentralized surgical education increases confidence and has a positive effect on perceptions about well-being and training. We hope to disseminate this course, leading to reproduction in other centers, refinement, and wide implementation.
A Pragmatic Non-Randomized Trial of Prehabilitation Prior to Cancer Surgery: Study Protocol and COVID-19-Related Adaptations

Daniel Santa Mina,Daniel Sellers,Darren Au,Shabbir M. H. Alibhai,Hance Clarke,Brian H. Cuthbertson,Gail Darling,Alaa El Danab,Anand Govindarajan,Karim Ladha,Andrew G. Matthew,Stuart McCluskey,Karen A. Ng,Fayez Quereshy,Keyvan Karkouti,Ian M. Randall

DOI: https://doi.org/10.3389/fonc.2021.629207

IF: 4.7

2021-03-10

Frontiers in Oncology

Abstract:Background Experimental data highlight the potential benefits and health system cost savings related to surgical prehabilitation; however, adequately powered randomized controlled trial (RCT) data remain nascent. Emerging prehabilitation services may be informed by early RCT data but can be limited in informing real-world program development. Pragmatic trials emphasize external validity and generalizability to understand and advise intervention development and implementation in clinical settings. This paper presents the methodology of a pragmatic prehabilitation trial to complement emerging phase III clinical trials and inform implementation strategies. Methods This is a pilot pragmatic clinical trial conducted in a large academic hospital in Toronto, Ontario, Canada to assess feasibility of clinical implementation and derive estimates of effectiveness. Feasibility data include program referral rates, enrolment and attrition, intervention adherence and safety, participant satisfaction, and barriers and facilitators to programming. The study aims to receive 150 eligible referrals for adult, English-speaking, preoperative oncology patients with an identified indication for prehabilitation ( e.g ., frailty, deconditioning, malnutrition, psychological distress). Study participants undergo a baseline assessment and shared-decision making regarding the intervention setting: either facility-based prehabilitation or home-based prehabilitation. In both scenarios, participants receive an individualized exercise prescription, stress-reduction psychological support, nutrition counseling, and protein supplementation, and if appropriate, smoking cessation program referrals. Secondary objectives include estimating intervention effects at the week prior to surgery and 30 and 90 days postoperatively. Outcomes include surgical complications, postoperative length of stay, mortality, hospital readmissions, physical fitness, psychological well-being, and quality of life. Data from participants who decline the intervention but consent for research-related access to health records will serve as comparators. The COVID-19 pandemic required the introduction of a ‘virtual program’ using only telephone or internet-based communication for screening, assessments, or intervention was introduced. Conclusion This pragmatic trial will provide evidence on the feasibility and viability of prehabilitation services delivered under usual clinical conditions. Study amendments due to the COVID-19 pandemic are presented as strategies to maintain prehabilitation research and services to potentially mitigate the consequences of extended surgery wait times.

oncology
How Well the Pragmatic Randomized Controls in Joint Replacement Field: Results from Precis, Consort and Iom Tools' Assessment

J. R. Chen,J. Wang,C. Li,T. Qin,X. Cen,J. Li

DOI: https://doi.org/10.1016/j.jval.2014.08.086

IF: 5.156

2014-01-01

Value in Health

Abstract:Evidence from real world are important for patients care. Pragmatic randomized control trial (PRCT) as one of the research methods of Comparative Effectiveness Research (CER) is used in many medical fields recently. This study aims to assess design and reporting qualities of PRCTs published in joint replacement fields. We searched the Medline, Embase, CENTRAL to February 2014 and the reference lists of retrieved studies to identify the full-report pragmatic randomized trials in English that compared Total Hip Replacement (THR) or Total Knee Replacement (TKR) with a conventional treatment. Three reviewers independently assess the quality of PRCTs by using the pragmatic-explanatory continuum indicator summary (PRECIS) tool, CONSORT statement guidelines and the six CER defining characteristics of the Institute of Medicine (IOM). We screened 55 potentially eligible abstracts and identified 6 full-text PRCTs of joint replacement fields. Finally 3 trials with 4,152 patients were assessed. Three reviewers scored the 3 trials based on PRECIS tool (39.5 vs 44 vs 36); CONSORT statement guidelines (36.5 vs 39 vs 37.5); IOM defining characteristics of CER (26.5 vs 29 vs 29). All 3 trials reported the clinical, economic and patient-centered outcomes. The Knee Arthroplasty Trial with 10 years’ follow-up was scored the highest and considered to be more closer to the real world than other two trials as it was conducted in 2352 patients from 34 UK centers and 116 surgeons in the study could adjusted their treatments based on individual patients’ characteristics. PRCT is different from standard RCT in many aspects. The number of PRCT in joint replacement field is limited and the quality need to be improved. PRECIS, CONSORT guidelines are useful for researchers in designing and reporting the PRCT.

Practical Guide to Pragmatic Clinical Trials in Surgical Education Research

Practical Guide to Experimental and Quasi-Experimental Research in Surgical Education

Practical Guide to Ethics in Surgical Education Research

Practical Guide to Survey Research in Surgical Education

Practical Guide to Qualitative Research in Surgical Education

Practical Guide to Surgical Simulation Research

Practical Guide to Common Flaws With Surgical Education Research

Practical Guide to Assessment Tool Development for Surgical Education Research

Practical trials in medical education: linking theory, practice and decision making

Practical Guide to Education Program Evaluation Research

Practical Guide to Machine Learning and Artificial Intelligence in Surgical Education Research

Pragmatism in Pediatric Neurosurgery: More Than a Pipe Dream? A Systematic Literature Review and Analysis

A review of pragmatic trials found a high degree of diversity in design and scope, deficiencies in reporting and trial registry data, and poor indexing

["Practical clinical competence" - a joint programme to improve training in surgery]

Praxis-Informed Pointers: A Student Guide for Optimizing Clinical Learning in a Resource-Constrained Setting

Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory

A Randomized Crossover Trial Evaluating the Impact of Cultural Dexterity Training on Surgical Residents’ Knowledge, Cross-Cultural Care, Skills, and Beliefs

Impact of laparoscopic training course for surgical trainees based on an evidence-based pedagogical framework: randomized trial

Teaching Basic Surgical Skills Using a More Frugal, Near-Peer, and Environmentally Sustainable Way: Mixed Methods Study

A Pragmatic Non-Randomized Trial of Prehabilitation Prior to Cancer Surgery: Study Protocol and COVID-19-Related Adaptations

How Well the Pragmatic Randomized Controls in Joint Replacement Field: Results from Precis, Consort and Iom Tools' Assessment