Reporting and methodological quality of COVID-19 systematic reviews needs to be improved: an evidence mapping
Yanfei Li,Liujiao Cao,Ziyao Zhang,Liangying Hou,Yu Qin,Xu Hui,Jing Li,Haitong Zhao,Gecheng Cui,Xudong Cui,Rui Li,Qingling Lin,Xiuxia Li,Kehu Yang
DOI: https://doi.org/10.1016/j.jclinepi.2021.02.021
IF: 7.407
2021-07-01
Journal of Clinical Epidemiology
Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objectives</h3><p>: To assess the reporting and methodological quality of COVID-19 systematic reviews, and to analyze trends and gaps in the quality, clinical topics, author countries, and populations of the reviews using an evidence mapping approach.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Study Design and Setting</h3><p>: A structured search for systematic reviews concerning COVID-19 was performed using PubMed, Embase, Cochrane Library, Campbell Library, Web of Science, CBM, WanFang Data, CNKI, and CQVIP from inception until June 2020. The quality of each review was assessed using the Assessment of Multiple Systematic Reviews 2 (AMSTAR 2) checklist and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>: In total, 243 systematic reviews met the inclusion criteria, over 50% of which (128, 52.7%) were from 14 developing countries, with China contributing the most reviews (76, 31.3%). In terms of methodological quality of the studies, 30 (12.3%) were of moderate quality, 63 (25.9%) were of low quality, and 150 (61.7%) were of critically low quality. In terms of reporting quality, the median (interquartile range) PRISMA score was 14 (10-18). Regarding the topics of the reviews, 24 (9.9%) focused on the prevalence of COVID-19, 69 (28.4%) focused on the clinical manifestations, 30 (12.3%) focused on etiology, 43 (17.7%) focused on diagnosis, 65 (26.7%) focused on treatment, 104 (42.8%) focused on prognosis, and 25 (10.3%) focused on prevention. These studies mainly focused on general patients with COVID-19 (161, 66.3%), followed by children (22, 9.1%) and pregnant patients (18, 7.4%).</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusions</h3><p>: This study systematically evaluated the methodological and reporting quality of systematic reviews of COVID-19, summarizing and analyzing trends in their clinical topics, author countries, and study populations.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">What is new?</h3><p>Key findings</p><dl class="list"><dt class="list-label">l</dt><dd class="list-description"><p>Overall, the reporting and methodological quality of the included SRs were low, especially the methodological quality.</p></dd><dt class="list-label">l</dt><dd class="list-description"><p>The methodological quality of almost all SRs related to prevalence, etiology, prognosis, prevention, and special populations (such as children and pregnant women) were assessed as being low or critically low quality. The reporting quality of SRs related to treatment, prevention, and special populations was also relatively low.</p></dd><dt class="list-label">l</dt><dd class="list-description"><p>Several evidence gaps were identified and a trend analysis of the clinical topics, countries, and study populations was performed.</p></dd></dl>What this adds to what was known?<dl class="list"><dt class="list-label">l</dt><dd class="list-description"><p>This is the first study to assess the reporting and methodological quality of COVID-19 systematic reviews.</p></dd></dl>What is the implication, what should change now?<dl class="list"><dt class="list-label">l</dt><dd class="list-description"><p>Considering the significance of systematic reviews of COVID-19, the reporting and methodological quality of these studies should be strengthened, especially the methodological quality. It is also necessary to discuss whether conventional quality assessment tools for systematic reviews are suitable during a public health emergency.</p></dd></dl>
public, environmental & occupational health,health care sciences & services