Validation of artificial intelligence-based digital microscopy for automated detection of Schistosoma haematobium eggs in urine in Gabon
Brice Meulah,Prosper Oyibo,Pytsje T Hoekstra,Paul Alvyn Nguema Moure,Moustapha Nzamba Maloum,Romeo Aime Laclong-Lontchi,Yabo Josiane Honkpehedji,Michel Bengtson,Cornelis Hokke,Paul L A M Corstjens,Temitope Agbana,Jan Carel Diehl,Ayola Akim Adegnika,Lisette van Lieshout,Pytsje T. Hoekstra,Paul L. A. M. Corstjens
DOI: https://doi.org/10.1371/journal.pntd.0011967
2024-02-25
PLoS Neglected Tropical Diseases
Abstract:Schistosomiasis is a significant public health concern, especially in Sub-Saharan Africa. Conventional microscopy is the standard diagnostic method in resource-limited settings, but with limitations, such as the need for expert microscopists. An automated digital microscope with artificial intelligence (Schistoscope), offers a potential solution. This field study aimed to validate the diagnostic performance of the Schistoscope for detecting and quantifying Schistosoma haematobium eggs in urine compared to conventional microscopy and to a composite reference standard (CRS) consisting of real-time PCR and the up-converting particle (UCP) lateral flow (LF) test for the detection of schistosome circulating anodic antigen (CAA). Based on a non-inferiority concept, the Schistoscope was evaluated in two parts: study A, consisting of 339 freshly collected urine samples and study B, consisting of 798 fresh urine samples that were also banked as slides for analysis with the Schistoscope. In both studies, the Schistoscope, conventional microscopy, real-time PCR and UCP-LF CAA were performed and samples with all the diagnostic test results were included in the analysis. All diagnostic procedures were performed in a laboratory located in a rural area of Gabon, endemic for S . haematobium . In study A and B, the Schistoscope demonstrated a sensitivity of 83.1% and 96.3% compared to conventional microscopy, and 62.9% and 78.0% compared to the CRS. The sensitivity of conventional microscopy in study A and B compared to the CRS was 61.9% and 75.2%, respectively, comparable to the Schistoscope. The specificity of the Schistoscope in study A (78.8%) was significantly lower than that of conventional microscopy (96.4%) based on the CRS but comparable in study B (90.9% and 98.0%, respectively). Overall, the performance of the Schistoscope was non-inferior to conventional microscopy with a comparable sensitivity, although the specificity varied. The Schistoscope shows promising diagnostic accuracy, particularly for samples with moderate to higher infection intensities as well as for banked sample slides, highlighting the potential for retrospective analysis in resource-limited settings. NCT04505046 ClinicalTrials.gov. Assessment of schistosomiasis control programs is a crucial step to understanding the success rate of these control programs. The Schistoscope: an AI-powered automated digital microscope could overcome the limitations of conventional microscopy in endemic resource limited settings as well as in settings lacking microscopy experts. In this study, we carried out an extensive validation of the Schistoscope's diagnostic performance for diagnosis of urogenital schistosomiasis compared to conventional microscopy as well as more accurate diagnostic tests such as real-time PCR and the up-converting particle (UCP) lateral flow (LF) test for the detection of circulating anodic antigen (CAA) on freshly collected urines. We also assessed the performance of the Schistoscope for the diagnosis of schistosomiasis on banked sample slides, using a simple and sustainable storage method, for approximately two years. Having a tool that can prospectively and retrospectively analyse samples in an easy and sustainable way could facilitate schistosomiasis control programs in settings with little or no access to microscopists. Overall, we found the Schistoscope to be as good as conventional microscopy for the diagnosis of schistosomiasis, and given its downstream advantages of digital health, it would serve as a valuable diagnostic/screening tool in resource limited endemic settings.
tropical medicine,parasitology