Assessing the impact of deep-learning assistance on the histopathological diagnosis of serous tubal intraepithelial carcinoma (STIC) in fallopian tubes

Joep Ma Bogaerts,Miranda P Steenbeek,John-Melle Bokhorst,Majke Hd van Bommel,Luca Abete,Francesca Addante,Mariel Brinkhuis,Alicja Chrzan,Fleur Cordier,Mojgan Devouassoux-Shisheboran,Juan Fernández-Pérez,Anna Fischer,C Blake Gilks,Angela Guerriero,Marta Jaconi,Tony G Kleijn,Loes Kooreman,Spencer Martin,Jakob Milla,Nadine Narducci,Chara Ntala,Vinita Parkash,Christophe de Pauw,Joseph T Rabban,Lucia Rijstenberg,Robert Rottscholl,Annette Staebler,Koen Van de Vijver,Gian Franco Zannoni,Monica van Zanten,AI‐STIC Study Group,Joanne A de Hullu,Michiel Simons,Jeroen Awm van der Laak,Joost Bart,Jessica L Bentz,Tjalling Bosse,Johan Bulten,Mohamed Mokhtar Desouki,Ricardo R Lastra,Tricia A Numan,J Kenneth Schoolmeester,Lauren E Schwartz,Ie-Ming Shih,T Rinda Soong,Gulisa Turashvili,Russell Vang,Mila Volchek,Riena P Aliredjo,Heidi Kusters-Vandevelde

DOI: https://doi.org/10.1002/2056-4538.70006

Abstract:In recent years, it has become clear that artificial intelligence (AI) models can achieve high accuracy in specific pathology-related tasks. An example is our deep-learning model, designed to automatically detect serous tubal intraepithelial carcinoma (STIC), the precursor lesion to high-grade serous ovarian carcinoma, found in the fallopian tube. However, the standalone performance of a model is insufficient to determine its value in the diagnostic setting. To evaluate the impact of the use of this model on pathologists' performance, we set up a fully crossed multireader, multicase study, in which 26 participants, from 11 countries, reviewed 100 digitalized H&E-stained slides of fallopian tubes (30 cases/70 controls) with and without AI assistance, with a washout period between the sessions. We evaluated the effect of the deep-learning model on accuracy, slide review time and (subjectively perceived) diagnostic certainty, using mixed-models analysis. With AI assistance, we found a significant increase in accuracy (p < 0.01) whereby the average sensitivity increased from 82% to 93%. Further, there was a significant 44 s (32%) reduction in slide review time (p < 0.01). The level of certainty that the participants felt versus their own assessment also significantly increased, by 0.24 on a 10-point scale (p < 0.01). In conclusion, we found that, in a diverse group of pathologists and pathology residents, AI support resulted in a significant improvement in the accuracy of STIC diagnosis and was coupled with a substantial reduction in slide review time. This model has the potential to provide meaningful support to pathologists in the diagnosis of STIC, ultimately streamlining and optimizing the overall diagnostic process.