Multicenter benchmarking of short and long read wet lab protocols for clinical viral metagenomics

F. Xavier Lopez-Labrador,Michael Huber,Igor A. Sidorov,Julianne R. Brown,Lize Cuypers,Lies Laenen,Bert Vanmechelen,Piet Maes,Nicole Fischer,Ian Pichler,Nathaniel Storey,Stefan Schmutz,Verena Kufner,Sander van Boheemen,Claudia E. Mulders,Adam Grundhoff,Patrick Blümke,Alexis Robitaille,Ondrej Cinek,Klára Hubáčková,Kees Mourik,Stefan A. Boers,Lea Stauber,Maud Salmona,Pierre Cappy,Alban Ramette,Alessandra Franze’,Jerome LeGoff,Eric C.J. Claas,Christophe Rodriguez,Jutte J.C. de Vries,European Society of Clinical Virology (ESCV) Network on Next-Generation Sequencing (ENNGS)
DOI: https://doi.org/10.1101/2024.01.14.24301284
2024-01-17
Abstract:Metagenomics is gradually being implemented for diagnosing infectious diseases. However, in-depth protocol comparisons for viral detection have been limited to individual sets of experimental workflows and laboratories. In this study, we present a benchmark of metagenomics protocols used in clinical diagnostic laboratories initiated by the European Society for Clinical Virology (ESCV) Network on NGS (ENNGS). A mock viral reference panel was designed to mimic low biomass clinical specimens. The panel was used to assess the performance of twelve metagenomic wet-lab protocols in use in the diagnostic laboratories of participating ENNGS member institutions. Both Illumina and Nanopore, shotgun and targeted capture probe protocols were included. Performance metrics sensitivity, specificity, and quantitative potential were assessed using a central bioinformatics pipeline. Overall, viral pathogens with loads down to 10 copies/ml (corresponding to C values of 31 in our assays) were detected by all the evaluated metagenomic wet-lab protocols. In contrast, lower abundant mixed viruses of C values of 35 and higher were detected only by a minority of the protocols. Considering the reference panel as the gold standard, optimal thresholds to define a positive result were determined per protocol, based on the horizontal genome coverage. Implementing these thresholds, sensitivity and specificity of the protocols ranged from 67 to 100% and 87 to 100%, respectively. A variety of metagenomic protocols are currently in use in clinical diagnostic laboratories. Detection of low abundant viral pathogens and mixed infections remains a challenge, implying the need for standardization of metagenomic analysis for use in clinical settings.
Infectious Diseases (except HIV/AIDS)
What problem does this paper attempt to address?