Uncovering Gaps in GRADE Reporting of Eastern Association for Surgeons of Trauma (EAST) Guidelines

Brett Norling,William Miller,Philipp Dahm
DOI: https://doi.org/10.1016/j.jclinepi.2024.111260
IF: 7.407
2024-01-14
Journal of Clinical Epidemiology
Abstract:Objectives To formally evaluate the uptake and reporting of the Grading of Recommendation Assessments, Development and Evaluation (GRADE) approach in clinical practice guidelines (CPGs) developed by the Eastern Association for the Surgery of Trauma (EAST). Study Design and Setting Based on an a priori , written protocol, we developed a dedicated data abstraction form that included the six suggested criteria for using and applying GRADE. By searching the EAST website, we identified all EAST guidelines that referenced the use of GRADE. All steps of the data abstraction process were completed independently and in duplicate by two members of the research team. Results We identified a total of 48 CPGs that used GRADE. Trauma and violence prevention (n=11; 23.9%) was the most common topic. The median number of PICO (patient/population, intervention, comparison and outcomes) questions addressed was 3 (IQR: 2; 4) with a median of 2.5 (IQR: 1; 4) critical outcomes. A conditional/weak recommendation was provided for n=79 (51.4%) PICOs whereas a strong recommendation was provided for 33 PICOs (23.9%). For 22 PICOs (15.9%), no recommendation was made. Nearly all guideline documents provided search dates (n=44; 95.7%) and a PRISMA flow diagram (n=44; 95.7%). Most described categories for rating down (n=35; 76.1%). GRADE decision-making domains related to the ratio of benefits to harms, values and preferences, and resource utilization were referenced by 43.5% (n=20), 43.5% (n=20), and 30.4% (n=14) of CPGs, respectively. For nearly half of PICO questions (n=59; 44.2%) authors did not provide an evidence profile or summary of findings table. Comparing time periods 2014-18 to 2019-22, the proportion of recommendations with an overall certainty of evidence increased (52.4% versus 83.9%; p < 0.001). Conclusion EAST has successfully adopted GRADE to develop many trauma-related guidelines, each addressing a finite number of focused clinical questions based on systematic reviews conducted in-house. Overall reporting improved over time. There is for improvement when it comes to consistent provision of an overall certainty of evidence, the reporting of the evidence-to-decision-making process, and the justification of strong recommendations based on low/very low certainty evidence.
public, environmental & occupational health,health care sciences & services
What problem does this paper attempt to address?