Abstract:Antimicrobial resistance (AMR) poses a threat to public health. Clinical microbiology laboratories typically rely on culturing bacteria for antimicrobial-susceptibility testing (AST). As the implementation costs and technical barriers fall, whole-genome sequencing (WGS) has emerged as a 'one-stop' test for epidemiological and predictive AST results. Few published comparisons exist for the myriad analytical pipelines used for predicting AMR. To address this, we performed an inter-laboratory study providing sets of participating researchers with identical short-read WGS data from clinical isolates, allowing us to assess the reproducibility of the bioinformatic prediction of AMR between participants, and identify problem cases and factors that lead to discordant results. We produced ten WGS datasets of varying quality from cultured carbapenem-resistant organisms obtained from clinical samples sequenced on either an Illumina NextSeq or HiSeq instrument. Nine participating teams ('participants') were provided these sequence data without any other contextual information. Each participant used their choice of pipeline to determine the species, the presence of resistance-associated genes, and to predict susceptibility or resistance to amikacin, gentamicin, ciprofloxacin and cefotaxime. We found participants predicted different numbers of AMR-associated genes and different gene variants from the same clinical samples. The quality of the sequence data, choice of bioinformatic pipeline and interpretation of the results all contributed to discordance between participants. Although much of the inaccurate gene variant annotation did not affect genotypic resistance predictions, we observed low specificity when compared to phenotypic AST results, but this improved in samples with higher read depths. Had the results been used to predict AST and guide treatment, a different antibiotic would have been recommended for each isolate by at least one participant. These challenges, at the final analytical stage of using WGS to predict AMR, suggest the need for refinements when using this technology in clinical settings. Comprehensive public resistance sequence databases, full recommendations on sequence data quality and standardization in the comparisons between genotype and resistance phenotypes will all play a fundamental role in the successful implementation of AST prediction using WGS in clinical microbiology laboratories.

Whole-genome sequencing to control antimicrobial resistance

Emerging Challenges of Whole-Genome-sequencing–powered Epidemiological Surveillance of Globally Distributed Clonal Groups of Bacterial Infections, Giving Acinetobacter Baumannii ST195 As an Example

The Present and Future of Whole Genome Sequencing (WGS) and Whole Metagenome Sequencing (WMS) for Surveillance of Antimicrobial Resistant Microorganisms and Antimicrobial Resistance Genes across the Food Chain

The role of whole genome sequencing in antimicrobial susceptibility testing of bacteria

Metagenomic-based surveillance systems for antibiotic resistance in non-clinical settings

Whole genome sequencing in clinical and public health microbiology

Contributions of Long-Read Sequencing for the Detection of Antimicrobial Resistance

Validation and Application of Long-Read Whole-Genome Sequencing for Antimicrobial Resistance Gene Detection and Antimicrobial Susceptibility Testing

Integrating Scalable Genome Sequencing Into Microbiology Laboratories for Routine Antimicrobial Resistance Surveillance

Whole-Genome Sequencing for Resistance Level Prediction in Multidrug-Resistant Tuberculosis

From Theory to Practice: Translating Whole-Genome Sequencing (WGS) into the Clinic

Integrating Culture-based Antibiotic Resistance Profiles with Whole-genome Sequencing Data for 11,087 Clinical Isolates

Whole-genome Sequencing: a Perspective on Sensing Bacterial Risk for Food Safety

Use of whole genome sequencing for surveillance and control of foodborne diseases: status quo and quo vadis

Clinical implementation of routine whole-genome sequencing for hospital infection control of multi-drug resistant pathogens

Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: an inter-laboratory study

Whole-genome sequencing for the characterization of resistance mechanisms and epidemiology of colistin-resistant Acinetobacter baumannii

Whole genome sequencing of uropathogenic E. coli from Ireland reveals diverse resistance mechanisms and strong correlation with phenotypic (EUCAST) susceptibility testing

Transforming clinical microbiology with bacterial genome sequencing

Whole Genome Sequencing: Applications in Clinical Microbiology

Next generation microbiological risk assessment: opportunities of whole genome sequencing (WGS) for foodborne pathogen surveillance, source tracking and risk assessment