Abstract:Despite being a well-established research method, the use of whole-genome sequencing (WGS) for routine molecular typing and pathogen characterization remains a substantial challenge due to the required bioinformatics resources and/or expertise. Moreover, many national reference laboratories and centers, as well as other laboratories working under a quality system, require extensive validation to demonstrate that employed methods are "fit-for-purpose" and provide high-quality results. A harmonized framework with guidelines for the validation of WGS workflows does currently, however, not exist yet, despite several recent case studies highlighting the urgent need thereof. We present a validation strategy focusing specifically on the exhaustive characterization of the bioinformatics analysis of a WGS workflow designed to replace conventionally employed molecular typing methods for microbial isolates in a representative small-scale laboratory, using the pathogen <i>Neisseria meningitidis</i> as a proof-of-concept. We adapted several classically employed performance metrics specifically toward three different bioinformatics assays: resistance gene characterization (based on the ARG-ANNOT, ResFinder, CARD, and NDARO databases), several commonly employed typing schemas (including, among others, core genome multilocus sequence typing), and serogroup determination. We analyzed a core validation dataset of 67 well-characterized samples typed by means of classical genotypic and/or phenotypic methods that were sequenced in-house, allowing to evaluate repeatability, reproducibility, accuracy, precision, sensitivity, and specificity of the different bioinformatics assays. We also analyzed an extended validation dataset composed of publicly available WGS data for 64 samples by comparing results of the different bioinformatics assays against results obtained from commonly used bioinformatics tools. We demonstrate high performance, with values for all performance metrics >87%, >97%, and >90% for the resistance gene characterization, sequence typing, and serogroup determination assays, respectively, for both validation datasets. Our WGS workflow has been made publicly available as a "push-button" pipeline for Illumina data at https://galaxy.sciensano.be to showcase its implementation for non-profit and/or academic usage. Our validation strategy can be adapted to other WGS workflows for other pathogens of interest and demonstrates the added value and feasibility of employing WGS with the aim of being integrated into routine use in an applied public health setting.

Bacterial genome sequencing in clinical microbiology: a pathogen-oriented review

Emerging Challenges of Whole-Genome-sequencing–powered Epidemiological Surveillance of Globally Distributed Clonal Groups of Bacterial Infections, Giving Acinetobacter Baumannii ST195 As an Example

Whole genome sequencing in clinical and public health microbiology

Whole Genome Sequencing: Applications in Clinical Microbiology

Transforming clinical microbiology with bacterial genome sequencing

Understanding the potential role of whole genome sequencing (WGS) in managing patients with gonorrhoea: A systematic review of WGS use on human pathogens in individual patient care

Rapid bacterial genome sequencing: methods and applications in clinical microbiology

Towards unified reporting of genome sequencing results in clinical microbiology

From Theory to Practice: Translating Whole-Genome Sequencing (WGS) into the Clinic

Use of whole genome sequencing for surveillance and control of foodborne diseases: status quo and quo vadis

Bacterial Whole Genome Sequencing on the Illumina iSeq 100 for Clinical and Public Health Laboratories

Clinical implementation of routine whole-genome sequencing for hospital infection control of multi-drug resistant pathogens

Metagenomics and Whole Genome Sequencing in Clinical Microbiology: A Narrative Review

Next Generation and Other Sequencing Technologies in Diagnostic Microbiology and Infectious Diseases

A systematic review of economic evaluations of whole-genome sequencing for the surveillance of bacterial pathogens

Whole Genome Sequencing for Genomics-Guided Investigations of Escherichia coli O157:H7 Outbreaks

Validation of a Bioinformatics Workflow for Routine Analysis of Whole-Genome Sequencing Data and Related Challenges for Pathogen Typing in a European National Reference Center: Neisseria meningitidis as a Proof-of-Concept

Evaluation of Rapid Library Preparation Protocols for Whole Genome Sequencing Based Outbreak Investigation

Whole Genome Sequencing of Mycobacterium Tuberculosis: Current Standards and Open Issues

Next generation microbiological risk assessment: opportunities of whole genome sequencing (WGS) for foodborne pathogen surveillance, source tracking and risk assessment

The role of whole genome sequencing in antimicrobial susceptibility testing of bacteria