Abstract:Abstract Aim: Our goal was to evaluate a novel deep learning system for integrated human-AI review of whole-slide images (WSIs) from the Cytosponge to predict progression from Barrett's esophagus (BE) to esophageal adenocarcinoma (EAC). Background: Fewer than 1% of BE patients advance to EAC, therefore delineating the patients at elevated risk is crucial for prioritizing their surveillance and treatment. Previous work has shown that the Cytosponge, a non-endoscopic test, coupled with biomarkers (TFF3, atypia, p53) can be used to identify and risk-stratify individuals with BE. However, the Cytosponge workflow to date has required a time consuming pathology review. Methods: We collected 1,700 BE Cytosponge WSIs from over 800 patients. We hand-drew over 30,000 digital annotations on the WSIs, a 300-hour collaborative effort between a computer scientist and 4 pathologists. Using these data for training, validation, and testing, we developed a deep learning system to determine whether cellular atypia and/or p53 overexpression is present. We used this system in a machine-assisted (MA) review process to highlight the most diagnostically interesting regions of WSIs for pathologist review. In our proposed system, patients are automatically triaged into high or low confidence positive, and high confidence negative classes for both atypia and p53 status, and only low confidence cases are sent for MA review. Results: Out of 23 architectures, the best atypia model achieves an accuracy of 0.90, and the best p53 model 0.96. The model was concordant with pathologists in 342/425 (80.5%) validation and 301/330 (91.2%) test-set patients. The system also identified 83 validation cases with atypia and/or p53 that were not previously reported by the pathologists. Of these, 29 (35%) were confirmed abnormal with the ground truth endoscopy biopsies (11 high grade dysplasia or intramucosal carcinoma, 14 low grade dysplasia, 5 indefinite for dysplasia). In the test set 29 results were discordant with pathology including 6 (21%) confirmed abnormal on endoscopy biopsies (3 HGD/IMC, 2 LGD, 1 IND). We used the models’ outputs to localize where these “missed” regions lie in the WSIs, and pathologist MA review confirmed the presence of focal abnormalities (cellular atypia +/- p53 aberrance) correctly identified by the algorithm. If pathologists only review cases for which the model had low confidence, this preserves overall performance while reducing pathologist workload over twenty-fold. MA review on the remaining WSIs is 4.7 times faster than standard review for atypia screening and 16.0 times faster for p53. Conclusion: This work shows the potential of an integrated human-AI WSI review process to drastically expedite a time consuming task and improve on pathologist performance when abnormal regions are easy for human eyes to miss. This work therefore lays the groundwork for similar machine-doctor approaches in other areas of medicine. Citation Format: Adam G. Berman, Ahmad Miremadi, Maria O'Donovan, Shalini Malhotra, Monika Tripathi, Rebecca C. Fitzgerald, Florian Markowetz. Clinical-grade early detection of esophageal cancer on data from a non-endoscopic device using deep learning. [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2023; Part 1 (Regular and Invited Abstracts); 2023 Apr 14-19; Orlando, FL. Philadelphia (PA): AACR; Cancer Res 2023;83(7_Suppl):Abstract nr 4321.

Using Machine Learning for Endoscopic Detection of Low-Grade Subglottic Stenosis: A Proof of Principle

AI-assisted Identification of Intrapapillary Capillary Loops in Magnification Endoscopy for Diagnosing Early-Stage Esophageal Squamous Cell Carcinoma: a Preliminary Study

Patch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images -- A Cross-Site Robustness Assessment

Machine Vision for Real-Time Intraoperative Anatomic Guidance: A Proof-of-Concept Study in Endoscopic Pituitary Surgery

Esophagogastroscopy for predicting endoscopic ultrasonography T-stage by utilizing deep learning methods in esophageal cancer

Abstract 4321: Clinical-grade early detection of esophageal cancer on data from a non-endoscopic device using deep learning

Identifying Laryngeal Neoplasms in Laryngoscope Images Via Deep Learning Based Object Detection: A Case Study on an Extremely Small Data Set

Feasibility of a deep learning algorithm to distinguish large cell neuroendocrine from small cell lung carcinoma in cytology specimens

Deep learning algorithm for the automated detection and classification of nasal cavity mass in nasal endoscopic images

Expert-level classification of gastritis by endoscopy using deep learning: a multicenter diagnostic trial

Real‐Time Laryngeal Cancer Boundaries Delineation on White Light and Narrow‐Band Imaging Laryngoscopy with Deep Learning

Real-time automated diagnosis of precancerous lesions and early esophageal squamous cell carcinoma using a deep learning model (with videos)

Deep learning-based identification of esophageal cancer subtypes through analysis of high-resolution histopathology images

Transferability of Deep Learning Algorithms for Malignancy Detection in Confocal Laser Endomicroscopy Images from Different Anatomical Locations of the Upper Gastrointestinal Tract

Deep Learning and Gastric Cancer: Systematic Review of AI-Assisted Endoscopy

Automatic Recognition of Laryngoscopic Images Using a Deep‐Learning Technique

Integrated deep learning model for automatic detection and classification of stenosis in coronary angiography

Deep learning-based facial analysis for predicting difficult videolaryngoscopy: a feasibility study

Deep learning for gastroscopic images: computer-aided techniques for clinicians

Application of endoscopic ultrasonography for detecting esophageal lesions based on convolutional neural network.

Deep Learning in High-Resolution Anoscopy: Assessing the Impact of Staining and Therapeutic Manipulation on Automated Detection of Anal Cancer Precursors