Abstract:Objective: Tumor HER2 expression is a key prognostic and treatment influencing factor in breast cancer. As with all immunohistochemistry (IHC) staining, visual interpretation of HER2 expression is subjective, which leads to intra- and inter-pathologist variability. Recent findings on the efficacy of HER2-targeted therapy on HER2-low patients raise the need for accurate and reproducible scoring. We developed a fully automated, artificial intelligence (AI) -based algorithm for HER2 scoring. The algorithm was based on ASCO/CAP 2018 guidelines and validated against rigorous ground truth (GT) established by multiple blinded expert pathologists. Methods: Algorithm development: We developed a solution that employs two steps: The first step consists of an ensemble of Deep Learning networks that process tissue regions and classify them as various tissue classes: Invasive cancer, Ductal Carcinoma In Situ (DCIS) and other morphologies. These networks were trained on slides that were automatically labeled by a separate AI system that analyzed the corresponding H&E slides and projected its findings to the HER2 IHC slides using a registration algorithm. To further enrich the training set, especially with rare and difficult cases, a team of 8 expert pathologists manually marked tissue areas and assigned them to one of the tissue classes. In total, the training set consisted of 6,400 manual annotations and 1,300 automatically-annotated slides, both collected from 9 laboratories and scanned using 3 different scanners. The second step is an ensemble of Object Detection networks that process only the regions classified as invasive cancer, detect the tumor cells within them, and classify their staining pattern (e.g., Not stained, Moderate incomplete, etc.). Finally, the detected cells are counted, and the ASCO/CAP guidelines are applied to derive the slide-level HER2 score. Validation: The validation set was comprised of 453 HER2 slides stained using the VENTANA anti-HER2/neu (4B5) Rabbit Monoclonal Primary Antibody as per manufacturer's instructions. HER2 slides included biopsies and excisions with different breast cancer diagnoses (e.g., Infiltrating Ductal Carcinoma (IDC), Infiltrating Lobular Carcinoma (ILC), rare invasive subtypes, with and without DCIS) from 3 different laboratories. Ground truth was established by the consensus scores of a panel of 3 pathologists, who scored HER2 according to the guidelines without additional clinical considerations, such as scoring borderline 1+/2+ cases as 2+ to have additional tests performed. Results: The algorithm showed very high performance for detecting invasive cancer in HER2 tissue sections, with AUC of 0.967 (measured on 4-fold Cross-Validation classifying invasive vs. other regional classes). The algorithm demonstrated an overall accuracy of 80.3% for the HER2 scores when compared to the GT. When using different cutoffs for binary classification the resulting performance was: for 0 vs 1+/2+/3+ Kappa was 0.800; 0/1+ vs 2+/3+ Kappa was 0.728; for 0/1+/2+ vs 3+ Kappa was 0.954. The Quadratic Kappa between the AI score and the GT was 0.898, which is considered almost perfect. The performance of the AI was similar across the different laboratories and diagnoses(e.g. IDC, ILC). Conclusion: This study reports the successful development and independent validation of a fully automatic AI-based solution for accurate HER2 scoring in breast cancer. AI solutions, such as the one reported here, could be used as decision-support tools for pathologists in routine clinical practice, enhancing the reproducibility and consistency of HER2 scoring, thus enabling optimal treatment pathways and better patient outcomes. Accurate and automatic IHC scoring solutions can also contribute to the development of new prognostic, predictive and companion diagnostic tools. Citation Format: Yuval Globerson, Lilach Bien, Jonathan Harel, Giuseppe Mallel, Geraldine Sebag, Michel Vandenberghe, Craig Barker, Tsuyoshi Matsuo, Charo Garrido, Judith Sandbank, Chaim Linhart. A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl) nr P6-04-05.

Toward High Resolution Scoring System for HER2 Expression in Breast Cancer Based on Pathological Images Via Deep Learning

Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling

Immunohistochemical HER2 Recognition and Analysis of Breast Cancer Based on Deep Learning

Automated Scoring System of HER2 in Pathological Images under the Microscope

Microscope Based HER2 Scoring System

Deep-Learning-Based Approach in Cancer-Region Assessment from HER2-SISH Breast Histopathology Whole Slide Images

Automated Quantification of HER2 Amplification Levels Using Deep Learning

Interpretable HER2 scoring by evaluating clinical Guidelines through a weakly supervised, constrained Deep Learning Approach

HER2 Molecular Marker Scoring Using Transfer Learning and Decision Level Fusion

Deep learning to automatically evaluate HER2 gene amplification status from fluorescence in situ hybridization images

Abstract P5-02-33: Deep learning-based assessment of HER2-low expression on breast cancer H&E digital whole slide images

Development of a Deep Learning model Tailored for HER2 Detection in Breast Cancer to aid pathologists in interpreting HER2-Low cases

Abstract P6-04-05: A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer

Leveraging Transfer Learning and Multiple Instance Learning for HER2 Automatic Scoring of H\&E Whole Slide Images

Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent

HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning

Automated segmentation of cell membranes to evaluate HER2 status in whole slide images using a modified deep learning network

Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images

Fully Automated Artificial Intelligence Solution for Human Epidermal Growth Factor Receptor 2 Immunohistochemistry Scoring in Breast Cancer: A Multireader Study

Label-Free Virtual HER2 Immunohistochemical Staining of Breast Tissue using Deep Learning

Digital profiling of cancer transcriptomes from histology images with grouped vision attention