Identifying individuals at high risk for HIV and sexually transmitted infections with an artificial intelligence-based risk assessment tool

Phyu M Latt,Nyi N Soe,Xianglong Xu,Jason J Ong,Eric P F Chow,Christopher K Fairley,Lei Zhang

DOI: https://doi.org/10.1093/ofid/ofae011

2024-01-08

Open Forum Infectious Diseases

Abstract:Abstract Introduction We have previously developed an artificial intelligence-based risk assessment tool to identify the individual risk of HIV and sexually transmitted infections (STIs) in a sexual health clinical setting. Based on this tool, the study aims to determine the optimal risk score thresholds to identify individuals at high risk for HIV/STIs. Methods Using 2008-2022 data from 216,252 HIV, 227,995 syphilis, 262,599 gonorrhoea, and 320,355 chlamydia consultations at a sexual health centre, we applied MySTIRisk machine learning models to estimate infection risk scores. Optimal cut-offs for determining high-risk individuals were determined using Youden’s index. Results The HIV risk score cut-off for high risk was 0.56, with 86.0% sensitivity (95% confidence interval (CI): 82.9-88.7%) and 65.6% specificity (65.4-65.8%). Thirty-five percent of participants were classified as high-risk, which accounted for 86% of HIV cases. The corresponding cut-offs were 0.49 for syphilis (sensitivity 77.6%, 76.2-78.9%; specificity 78.1%, 77.9-78.3%), 0.52 for gonorrhoea (sensitivity 78.3%, 77.6-78.9%; specificity 71.9%, 71.7-72.0%), and 0.47 for chlamydia (sensitivity 68.8%, 68.3-69.4%; specificity 63.7%, 63.5-63.8%). High-risk groups identified using these thresholds accounted for 78% of syphilis, 78% of gonorrhoea, and 69% of chlamydia cases. The odds of positivity were significantly higher in the high-risk group than otherwise across all infections: 11.4 (9.3-14.8) times for HIV, 12.3 (11.4-13.3) for syphilis, 9.2 (8.8-9.6) for gonorrhoea, and 3.9 (3.8-4.0) for chlamydia. Conclusions Risk scores generated by the AI-based risk assessment tool MySTIRisk, together with Youden’s index, are effective in determining high-risk subgroups for HIV/STIs. The thresholds can aid targeted HIV/STI screening and prevention.

immunology,infectious diseases,microbiology