Abstract:Background The ability to accurately identify the absolute risk of neurosyphilis diagnosis for patients with syphilis would allow preventative and therapeutic interventions to be delivered to patients at high-risk, sparing patients at lowrisk from unnecessary care. We aimed to develop, validate, and evaluate the clinical utility of simplified clinical diagnostic models for neurosyphilis diagnosis in HIV-negative patients with syphilis. Methods We searched PubMed, China National Knowledge Infrastructure and UpToDate for publications about neurosyphilis diagnostic guidelines in English or Chinese from database inception until March 15, 2023. We developed and validated machine learning models with a uniform set of predictors based on six authoritative diagnostic guidelines across four continents to predict neurosyphilis using routinely collected data from real-world clinical practice in China and the United States (through the Dermatology Hospital of Southern Medical University in Guangzhou [659 recruited between August 2012 and March 2022, treated as Development cohort], the Beijing Youan Hospital of Capital Medical University in Beijng [480 recruited between December 2013 and April 2021, treated as External cohort 1], the Zhongshan Hospital of Xiamen University in Xiamen [493 recruited between November 2005 and November 2021, treated as External cohort 2] from China, and University of Washington School of Medicine in Seattle [16 recruited between September 2002 and April 2014, treated as External cohort 3] from United States). We included all these patients with syphilis into our analysis, and no patients were further excluded. We trained eXtreme gradient boosting (XGBoost) models to predict the diagnostic outcome of neurosyphilis according to each diagnostic guideline in two scenarios, respectively. Model performance was measured through both internal and external validation in terms of discrimination and calibration, and clinical utility was evaluated using decision curve analysis. Findings The final simplified clinical diagnostic models included neurological symptoms, cerebrospinal fluid (CSF) protein, CSF white blood cell, and CSF venereal disease research laboratory test/rapid plasma reagin. The models showed good calibration with rescaled Brier score of 0.99 (95% CI 0.98-1.00) and excellent discrimination (the minimum value of area under the receiver operating characteristic curve, 0.84; 95% CI 0.81-0.88) when externally validated. Decision curve analysis demonstrated that the models were useful across a range of neurosyphilis probability thresholds between 0.33 and 0.66 compared to the alternatives of managing all patients with syphilis as if they do or do not have neurosyphilis. Interpretation The simplified clinical diagnostic models comprised of readily available data show good performance, are generalisable across clinical settings, and have clinical utility over a broad range of probability thresholds. The models with a uniform set of predictors can simplify the sophisticated clinical diagnosis of neurosyphilis, and guide decisions on delivery of neurosyphilis health-care, ultimately, support accurate diagnosis and necessary treatment.

Large‐Scale Proteome Profiling Identifies Biomarkers Associated with Suspected Neurosyphilis Diagnosis

Surrogate biomarkers identification for neuropsychiatric lupus by proteomic fingerprint technology

Identify Biomarkers of Neuropsychiatric Systemic Lupus Erythematosus by Matrix-assisted Laser Desorption/Ionization Time-of-Flight Mass Spectrometry Combined with Weak Cation Magnetic Beads

Exosomal Microrna Profiles from Serum and Cerebrospinal Fluid in Neurosyphilis.

Neutrophil-associated Proteins as Novel Biomarkers Elevated in Cerebrospinal Fluid of Neurosyphilis Patients

Identification of Glycoproteins in Human Cerebrospinal Fluid with a Complementary Proteomic Approach

Comparing Noninvasive Predictors of Neurosyphilis among Syphilis Patients with and Without HIV Co-Infection Based on the Real-World Diagnostic Criteria: A Single-Center, Retrospective Cohort Study in China.

Metabolite Profiles of the Cerebrospinal Fluid in Neurosyphilis Patients Determined by Untargeted Metabolomics Analysis

Increased CCL24 and CXCL7 Levels in the Cerebrospinal Fluid of Patients with Neurosyphilis

Clinical Characteristics, Diagnosis, and Predictors of Neurosyphilis Patients with Human Immunodeficiency Virus Co-Infection

Diagnosis of Neurosyphilis in HIV-negative Patients with Syphilis: Development, Validation, and Clinical Utility of a Suite of Machine Learning Models

Characteristic profiling of soluble factors in the cerebrospinal fluid of patients with neurosyphilis

Predicting asymptomatic neurosyphilis using peripheral blood indicators

Clinical Prediction and Diagnosis of Neurosyphilis in HIV-negative Patients: a Case-Control Study

Clinical and laboratory features of neurosyphilis: A single-center, retrospective study of 402 patients

The clinical and laboratory features of neurosyphilis in HIV-infected patients: A retrospective study in 92 patients.

The Clinical and Laboratory Features of Neurosyphilis in HIV-infected Patients

Neurosyphilis with a rare magnetic resonance imaging pattern confirmed by metagenomic next-generation sequencing: a case report

Neurosyphilis is characterized by a compartmentalized and robust neuroimmune response but not by neuronal injury

Novel CSF Biomarkers for Diagnosis and Integrated Analysis of Neuropsychiatric Systemic Lupus Erythematosus: Based on Antibody Profiling.

Cerebrospinal Fluid Changes and Clinical Features of Neurosyphilis Compared with Latent Syphilis Infection in the Central Nervous System: A Cross-Sectional Study