Abstract:Introduction Human epidermal growth factor receptor 2 (HER2) protein overexpression and/or HER2 gene amplification is found in about 20% of invasive breast cancers. Considering the results of the DESTINY-Breast trials confirming the remarkable efficacy of anti-HER2 antibody drug-conjugate (T-Dxd) in both HER2-overexpressed and HER2-low tumors, it is necessary to identify not only HER2 (immunohistochemistry (IHC) score 3+) overexpressing tumors, but also HER2-low tumors. The latter category, defined as IHC1+ or IHC2+ but non-amplified, has proven to be challenging even for experienced pathologists, with high inter-observer variability. Here, we validate the performance of a deep learning (DL) model at: 1) predicting the IHC score from IHC histological features and 2) identifying HER2-low tumors with high sensitivity. Methods 675 HER2 stained IHC slides from primary breast cancer patients were selected based on pathology reports across three different cohorts (KCL_GSTT_1 n=369; Cypath_Breast n=214; KCL_GSTT_2 n=92). The slides were digitized and reviewed by expert breast pathologists. Specifically, Cypath_Breast and KCL_GSTT_2 were each annotated by one expert pathologist, while KCL_GSTT_1 was annotated by 5 expert pathologists with the ground truth defined as a majority vote between the 5 annotators. Cypath_Breast was assigned as the "discovery" set; while KCL_GSTT_1 and KCL_GSTT_2 were used as two independent validation cohorts. The model was specifically trained to extract features from IHC tiles to ensure they would capture both the staining intensity and the staining location on the cells (membrane, cytoplasmic or nuclei). The one-vs-one (OVO) and one-vs-rest (OVR) AUC as well as sensitivity and specificity to HER2-low and positive tumors were used as metrics to assess the performance of our model. An expert pathologist reviewed the most predictive regions of HER2 expression. Results After review by expert pathologists, 59 slides from KCL_GSTT_1 were removed either because of folded tissue, blurriness or because there was too little tissue. The IHC scores (0/1+/2+/3+) for the 3 cohorts were distributed as follows; Cypath_Breast: 42/120/36/16; KCL_GSTT_1: 120/90/52/48; KCL_GSTT_2: 54/22/15/1. For KCL_GSTT_1, the average agreement between the 5 expert pathologists amounted to a Cohen's Kappa score of 0.63. Following training on Cypath_Breast, the performance of the model are presented in An ablation study proved that a feature extractor trained on IHC tiles outperformed an in-house extractor solely trained on H&E tiles (OVO AUC 0.95 vs 0.93 on KCL_GSTT_1; DeLong p< 0.001). Specifically, the model performed best at distinguishing HER2-negative (HER2 IHC 0) from HER2-low and HER2-positive tumors with a sensitivity (0 vs 1+/2+/3+) of 0.95 [0.93 - 0.98] and a specificity (0 vs 1+/2+/3+) of 0.78 [0.72 - 0.84] on KCL_GSTT_1. We observed the same tendency on KCL_GSTT_2 with a sensitivity (0 vs 1+/2+/3+) of 0.97 [0.91 - 1.00] and a specificity of 0.91 [0.83 - 0.98]. More importantly, the DL model reached a Cohen's Kappa score of 0.72 [0.67 - 0.77] with the ground truth on KCL_GSTT_1, surpassing the average agreement Kappa score between expert pathologists (0.63). The most predictive regions showed cytoplasmic staining in tumor regions. Conclusion Our model provides a path towards a fully automated workflow for identifying up to 95% of breast cancer patients who could potentially benefit from anti-HER2 targeted therapies. Additionally, we show the utility of AI-based tools to minimize discrepancies among pathologists and assist in the diagnostic patient pathway. Table 1: Results of external validation on KCL_GSTT_1 and KCL_GSTT_2 Cohorts OVO AUC OVR AUC IHC 0 OVR AUC IHC 1+ OVR AUC IHC 2+ OVR AUC IHC 3+ KCL_GSTT_1 0.95 0.95 0.80 0.91 0.99 [0.93 - 0.96] [0.94 - 0.95] [0.79 - 0.82] [0.90 - 0.92] [0.99 - 1.00] KCL_GSTT_2 0.92 0.97 0.78 0.84 N/A [0.90 - 0.93] [0.96 - 0.98] [0.76 - 0.81] [0.80 - 0.88] Citation Format: Pierre-Antoine Bannier, Loïc Herpin, Rémy Dubois, Lydwine Van Praet, Charles Maussion, Ellen Amonoo, Anca Mera, Jasmine Timbres, Cheryl Gillett, Elinor Sawyer, Patrycja Gazinska, Piotr Ziolkowski, Roberto Salgado, Sheeba Irshad. Deep learning model for automated quantification of HER2 expression in invasive breast cancers from immunohistochemical whole slide images [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl) nr PO2-07-05.

Abstract 6177: Machine learning enables prediction of ADC targets from whole slide H&E images

Abstract P5-02-33: Deep learning-based assessment of HER2-low expression on breast cancer H&E digital whole slide images

Machine learning enabled prediction of digital biomarkers from whole slide histopathology images

Abstract 5354: Prediction of OncotypeDX high risk group for chemotherapy benefit in breast cancer by deep learning analysis of hematoxylin and eosin-stained whole slide images

Abstract B092: Development of predictive models for expression of a tumor specific biomarker and CD3 on H&E digital slides

Abstract 6554: Prediction of MET amplification from H&E images in non small cell lung cancer using self-supervised deep learning and its role in clinical trial enrollment

Abstract 7380: Predicting immunotherapy outcomes from H&E images in lung cancer

Abstract 4951: Integrative multi-omic machine learning model predicts neoadjuvant immunotherapy response using molecular data and deep learning-derived features from digital pathology

Abstract 5436: Developing artificial intelligence algorithms to predict response to neoadjuvant chemotherapy in HER2-positive breast cancer

Abstract PO2-07-05: Deep learning model for automated quantification of HER2 expression in invasive breast cancers from immunohistochemical whole slide images

Abstract 7392: Machine learning-based identification of H&E-derived morphologic features associated with CD8+ T cell immune exclusion

Abstract 471: AIM PD-L1-NSCLC: Artificial intelligence-powered PD-L1 quantification for accurate prediction of tumor proportion score in diverse, multi-stain clinical tissue samples

Abstract 4298: Predicting tumor evolution from digital histology using AI

Abstract B082: Early risk stratification of ER+/HER2– breast cancer patients using digital pathology and multi-task, weakly-supervised deep learning

Abstract 3799: Spatial biomarker prediction in papillary renal cell carcinoma using artificial intelligence-based immunofluorescent inference

Abstract 6187: Multimodal characterization of tertiary lymphoid structures identified via deep learning on digitized H&E images in NSCLC

Abstract 2310: Integrating real-world histopathological and clinicogenomic data from 1799 lung cancer patients by applying unsupervised deep learning

Abstract P6-04-15: AI-based prediction of tertiary lymphoid structures and lymphocyte immune infiltration in breast carcinomas

Abstract PO4-01-10: Multi-modal artificial intelligence models from baseline histopathology predict prognosis in HR+ HER2- early breast cancer

Abstract 7402: Foundation AI models predict molecular measurements of tumor purity

Abstract 3514: A deep learning model for detection and characterization of tertiary lymphoid structures in H&E-stained images from pancreatic ductal adenocarcinoma