Abstract:Objective: Tumor HER2 expression is a key prognostic and treatment influencing factor in breast cancer. As with all immunohistochemistry (IHC) staining, visual interpretation of HER2 expression is subjective, which leads to intra- and inter-pathologist variability. Recent findings on the efficacy of HER2-targeted therapy on HER2-low patients raise the need for accurate and reproducible scoring. We developed a fully automated, artificial intelligence (AI) -based algorithm for HER2 scoring. The algorithm was based on ASCO/CAP 2018 guidelines and validated against rigorous ground truth (GT) established by multiple blinded expert pathologists. Methods: Algorithm development: We developed a solution that employs two steps: The first step consists of an ensemble of Deep Learning networks that process tissue regions and classify them as various tissue classes: Invasive cancer, Ductal Carcinoma In Situ (DCIS) and other morphologies. These networks were trained on slides that were automatically labeled by a separate AI system that analyzed the corresponding H&E slides and projected its findings to the HER2 IHC slides using a registration algorithm. To further enrich the training set, especially with rare and difficult cases, a team of 8 expert pathologists manually marked tissue areas and assigned them to one of the tissue classes. In total, the training set consisted of 6,400 manual annotations and 1,300 automatically-annotated slides, both collected from 9 laboratories and scanned using 3 different scanners. The second step is an ensemble of Object Detection networks that process only the regions classified as invasive cancer, detect the tumor cells within them, and classify their staining pattern (e.g., Not stained, Moderate incomplete, etc.). Finally, the detected cells are counted, and the ASCO/CAP guidelines are applied to derive the slide-level HER2 score. Validation: The validation set was comprised of 453 HER2 slides stained using the VENTANA anti-HER2/neu (4B5) Rabbit Monoclonal Primary Antibody as per manufacturer's instructions. HER2 slides included biopsies and excisions with different breast cancer diagnoses (e.g., Infiltrating Ductal Carcinoma (IDC), Infiltrating Lobular Carcinoma (ILC), rare invasive subtypes, with and without DCIS) from 3 different laboratories. Ground truth was established by the consensus scores of a panel of 3 pathologists, who scored HER2 according to the guidelines without additional clinical considerations, such as scoring borderline 1+/2+ cases as 2+ to have additional tests performed. Results: The algorithm showed very high performance for detecting invasive cancer in HER2 tissue sections, with AUC of 0.967 (measured on 4-fold Cross-Validation classifying invasive vs. other regional classes). The algorithm demonstrated an overall accuracy of 80.3% for the HER2 scores when compared to the GT. When using different cutoffs for binary classification the resulting performance was: for 0 vs 1+/2+/3+ Kappa was 0.800; 0/1+ vs 2+/3+ Kappa was 0.728; for 0/1+/2+ vs 3+ Kappa was 0.954. The Quadratic Kappa between the AI score and the GT was 0.898, which is considered almost perfect. The performance of the AI was similar across the different laboratories and diagnoses(e.g. IDC, ILC). Conclusion: This study reports the successful development and independent validation of a fully automatic AI-based solution for accurate HER2 scoring in breast cancer. AI solutions, such as the one reported here, could be used as decision-support tools for pathologists in routine clinical practice, enhancing the reproducibility and consistency of HER2 scoring, thus enabling optimal treatment pathways and better patient outcomes. Accurate and automatic IHC scoring solutions can also contribute to the development of new prognostic, predictive and companion diagnostic tools. Citation Format: Yuval Globerson, Lilach Bien, Jonathan Harel, Giuseppe Mallel, Geraldine Sebag, Michel Vandenberghe, Craig Barker, Tsuyoshi Matsuo, Charo Garrido, Judith Sandbank, Chaim Linhart. A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl) nr P6-04-05.

HER2 Molecular Marker Scoring Using Transfer Learning and Decision Level Fusion

Leveraging Transfer Learning and Multiple Instance Learning for HER2 Automatic Scoring of H\&E Whole Slide Images

Immunohistochemical HER2 Recognition and Analysis of Breast Cancer Based on Deep Learning

A Novel Decision Level Class-Wise Ensemble Method in Deep Learning for Automatic Multi-Class Classification of HER2 Breast Cancer Hematoxylin-Eosin Images

Interpretable HER2 scoring by evaluating clinical Guidelines through a weakly supervised, constrained Deep Learning Approach

Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling

Toward High Resolution Scoring System for HER2 Expression in Breast Cancer Based on Pathological Images Via Deep Learning

HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning

Strategies for Enhancing the Multi-Stage Classification Performances of HER2 Breast Cancer from Hematoxylin and Eosin Images

Deep-Learning-Based Approach in Cancer-Region Assessment from HER2-SISH Breast Histopathology Whole Slide Images

Automated Quantification of HER2 Amplification Levels Using Deep Learning

Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma

Classifying breast cancer using transfer learning models based on histopathological images

Using Deep Learning to Predict Final HER2 Status in Invasive Breast Cancers That are Equivocal (2+) by Immunohistochemistry

Automated segmentation of cell membranes to evaluate HER2 status in whole slide images using a modified deep learning network

Her2 Challenge Contest: A Detailed Assessment of Automated Her2 Scoring Algorithms in Whole Slide Images of Breast Cancer Tissues

Automated Scoring System of HER2 in Pathological Images under the Microscope

Improved Breast Cancer Diagnosis through Transfer Learning on Hematoxylin and Eosin Stained Histology Images

Abstract P6-04-05: A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer

Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoring

Microscope Based HER2 Scoring System