Abstract:Background: Assigning meaningful probabilities of SARS-CoV-2 infection risk presents a diagnostic challenge across the continuum of care. Objective: The aim of this study was to develop and clinically validate an adaptable, personalized diagnostic model to assist clinicians in ruling in and ruling out COVID-19 in potential patients. We compared the diagnostic performance of probabilistic, graphical, and machine learning models against a previously published benchmark model. Methods: We integrated patient symptoms and test data using machine learning and Bayesian inference to quantify individual patient risk of SARS-CoV-2 infection. We trained models with 100,000 simulated patient profiles based on 13 symptoms and estimated local prevalence, imaging, and molecular diagnostic performance from published reports. We tested these models with consecutive patients who presented with a COVID-19-compatible illness at the University of California San Diego Medical Center over the course of 14 days starting in March 2020. Results: We included 55 consecutive patients with fever (n=43, 78%) or cough (n=42, 77%) presenting for ambulatory (n=11, 20%) or hospital care (n=44, 80%). In total, 51% (n=28) were female and 49% (n=27) were aged <60 years. Common comorbidities included diabetes (n=12, 22%), hypertension (n=15, 27%), cancer (n=9, 16%), and cardiovascular disease (n=7, 13%). Of these, 69% (n=38) were confirmed via reverse transcription-polymerase chain reaction (RT-PCR) to be positive for SARS-CoV-2 infection, and 20% (n=11) had repeated negative nucleic acid testing and an alternate diagnosis. Bayesian inference network, distance metric learning, and ensemble models discriminated between patients with SARS-CoV-2 infection and alternate diagnoses with sensitivities of 81.6%-84.2%, specificities of 58.8%-70.6%, and accuracies of 61.4%-71.8%. After integrating imaging and laboratory test statistics with the predictions of the Bayesian inference network, changes in diagnostic uncertainty at each step in the simulated clinical evaluation process were highly sensitive to location, symptom, and diagnostic test choices. Conclusions: Decision support models that incorporate symptoms and available test results can help providers diagnose SARS-CoV-2 infection in real-world settings.

Optimal classification and generalized prevalence estimates for diagnostic settings with more than two classes

Prevalence Estimation and Optimal Classification Methods to Account for Time Dependence in Antibody Levels

Optimal Decision Theory for Diagnostic Testing: Minimizing Indeterminate Classes with Applications to Saliva-Based SARS-CoV-2 Antibody Assays

Analysis of Diagnostics (Part I): Prevalence, Uncertainty Quantification, and Machine Learning

Estimation of Covid-19 Prevalence from Serology Tests: A Partial Identification Approach

Prevalence estimation methods for time-dependent antibody kinetics of infected and vaccinated individuals: a graph-theoretic approach

Minimizing Uncertainty in Prevalence Estimates

Estimating Seroprevalence of SARS-CoV-2 in Ohio: A Bayesian Multilevel Poststratification Approach with Multiple Diagnostic Tests

Optimal group testing designs for estimating prevalence with uncertain testing errors

A Two-Stage Bayesian Method for Estimating Accuracy and Disease Prevalence for Two Dependent Dichotomous Screening Tests when the Status of Individuals Who Are Negative on Both Tests is Unverified

A Design and Analytic Strategy for Monitoring Disease Positivity and Case Characteristics in Accessible Closed Populations

Analysis of Diagnostics (Part II): Prevalence, Linear Independence, and Unsupervised Learning

The impact of inaccurate assumptions about antibody test accuracy on the parametrisation and results of infectious disease models of epidemics

A Design and Analytical Strategy for Monitoring Disease Positivity and Biomarker Levels in Accessible Closed Populations

Vaccine efficacy for binary post-infection outcomes under misclassification without monotonicity

A proactive/reactive mass screening approach with uncertain symptomatic cases

Computing SARS-CoV-2 Infection Risk From Symptoms, Imaging, and Test Data: Diagnostic Model Development

Estimation of odds ratio from group testing data with misclassified exposure

Prevalence Threshold and bounds in the Accuracy of Binary Classification Systems

Estimates of sensitivity and specificity of serological tests for SARS-CoV-2 specific antibodies using a Bayesian latent class model approach

Bayesian Prevalence Estimation from Pooled and Individual Data