Abstract:Prediction of antibiotic resistance phenotypes from whole genome sequencing data by machine learning methods has been proposed as a promising platform for the development of sequence-based diagnostics. However, there has been no systematic evaluation of factors that may influence performance of such models, how they might apply to and vary across clinical populations, and what the implications might be in the clinical setting. Here, we performed a meta-analysis of seven large Neisseria gonorrhoeae datasets, as well as Klebsiella pneumoniae and Acinetobacter baumannii datasets, with whole genome sequence data and antibiotic susceptibility phenotypes using set covering machine classification, random forest classification, and random forest regression models to predict resistance phenotypes from genotype. We demonstrate how model performance varies by drug, dataset, resistance metric, and species, reflecting the complexities of generating clinically relevant conclusions from machine learning-derived models. Our findings underscore the importance of incorporating relevant biological and epidemiological knowledge into model design and assessment and suggest that doing so can inform tailored modeling for individual drugs, pathogens, and clinical populations. We further suggest that continued comprehensive sampling and incorporation of up-to-date whole genome sequence data, resistance phenotypes, and treatment outcome data into model training will be crucial to the clinical utility and sustainability of machine learning-based molecular diagnostics.Machine learning-based prediction of antibiotic resistance from bacterial genome sequences represents a promising tool to rapidly determine the antibiotic susceptibility profile of clinical isolates and reduce the morbidity and mortality resulting from inappropriate and ineffective treatment. However, while there has been much focus on demonstrating the diagnostic potential of these modeling approaches, there has been little assessment of potential caveats and prerequisites associated with implementing predictive models of drug resistance in the clinical setting. Our results highlight significant biological and technical challenges facing the application of machine learning-based prediction of antibiotic resistance as a diagnostic tool. By outlining specific factors affecting model performance, our findings provide a framework for future work on modeling drug resistance and underscore the necessity of continued comprehensive sampling and reporting of treatment outcome data for building reliable and sustainable diagnostics.

Novel Clinical mNGS-Based Machine Learning Model for Rapid Antimicrobial Susceptibility Testing of Acinetobacter baumannii

Identification of Antibiotic Resistance in ESKAPE Pathogens through Plasmonic Nanosensors and Machine Learning

Machine learning and feature extraction for rapid antimicrobial resistance prediction of Acinetobacter baumannii from whole-genome sequencing data

Machine Learning Assisted MALDI Mass Spectrometry for Rapid Antimicrobial Resistance Prediction in Clinicals

Repurposing MALDI-TOF MS for effective antibiotic resistance screening in Staphylococcus epidermidis using machine learning

Machine learning models for Neisseria gonorrhoeae antimicrobial susceptibility tests

Accurate and rapid antibiotic susceptibility testing using a machine learning-assisted nanomotion technology platform

Neural network-based predictions of antimicrobial resistance phenotypes in multidrug-resistant Acinetobacter baumannii from whole genome sequencing and gene expression

Rapid inference of antibiotic resistance and susceptibility for Klebsiella pneumoniae by clinical shotgun metagenomic sequencing

Elucidating Resistance Mechanisms in : A High-Performing MALDI-TOF MS-Based Proteomic Approach for Predictive Modeling

Rapid AMR prediction in Pseudomonas aeruginosa combining MALDI-TOF MS with DNN model

Prediction of antimicrobial resistance based on whole-genome sequencing and machine learning

Discrimination of Methicillin-resistant Staphylococcus aureus by MALDI-TOF Mass Spectrometry with Machine Learning Techniques in Patients with Staphylococcus aureus Bacteremia

Rapid antimicrobial susceptibility testing for mixed bacterial infection in urine by AI-stimulated Raman scattering metabolic imaging

Combination of MALDI-TOF Mass Spectrometry and Machine Learning for Rapid Antimicrobial Resistance Screening: The Case of Campylobacter spp.

Direct prediction of antimicrobial resistance in Pseudomonas aeruginosa by metagenomic next-generation sequencing

Prediction of Antibiotic Susceptibility in E. coli Isolates Using Machine Learning

Machine Learning Techniques for Antimicrobial Resistance Prediction of Pseudomonas Aeruginosa from Whole Genome Sequence Data

Rapid personalized AMR diagnostics using two-dimensional antibiotic resistance profiling strategy employing a thermometric NDM-1 biosensor

Evaluation of parameters affecting performance and reliability of machine learning-based antibiotic susceptibility testing from whole genome sequencing data

Diagnostic performance and clinical impact of blood metagenomic next-generation sequencing in ICU patients suspected monomicrobial and polymicrobial bloodstream infections