Abstract:Objective: Tumor HER2 expression is a key prognostic and treatment influencing factor in breast cancer. As with all immunohistochemistry (IHC) staining, visual interpretation of HER2 expression is subjective, which leads to intra- and inter-pathologist variability. Recent findings on the efficacy of HER2-targeted therapy on HER2-low patients raise the need for accurate and reproducible scoring. We developed a fully automated, artificial intelligence (AI) -based algorithm for HER2 scoring. The algorithm was based on ASCO/CAP 2018 guidelines and validated against rigorous ground truth (GT) established by multiple blinded expert pathologists. Methods: Algorithm development: We developed a solution that employs two steps: The first step consists of an ensemble of Deep Learning networks that process tissue regions and classify them as various tissue classes: Invasive cancer, Ductal Carcinoma In Situ (DCIS) and other morphologies. These networks were trained on slides that were automatically labeled by a separate AI system that analyzed the corresponding H&E slides and projected its findings to the HER2 IHC slides using a registration algorithm. To further enrich the training set, especially with rare and difficult cases, a team of 8 expert pathologists manually marked tissue areas and assigned them to one of the tissue classes. In total, the training set consisted of 6,400 manual annotations and 1,300 automatically-annotated slides, both collected from 9 laboratories and scanned using 3 different scanners. The second step is an ensemble of Object Detection networks that process only the regions classified as invasive cancer, detect the tumor cells within them, and classify their staining pattern (e.g., Not stained, Moderate incomplete, etc.). Finally, the detected cells are counted, and the ASCO/CAP guidelines are applied to derive the slide-level HER2 score. Validation: The validation set was comprised of 453 HER2 slides stained using the VENTANA anti-HER2/neu (4B5) Rabbit Monoclonal Primary Antibody as per manufacturer's instructions. HER2 slides included biopsies and excisions with different breast cancer diagnoses (e.g., Infiltrating Ductal Carcinoma (IDC), Infiltrating Lobular Carcinoma (ILC), rare invasive subtypes, with and without DCIS) from 3 different laboratories. Ground truth was established by the consensus scores of a panel of 3 pathologists, who scored HER2 according to the guidelines without additional clinical considerations, such as scoring borderline 1+/2+ cases as 2+ to have additional tests performed. Results: The algorithm showed very high performance for detecting invasive cancer in HER2 tissue sections, with AUC of 0.967 (measured on 4-fold Cross-Validation classifying invasive vs. other regional classes). The algorithm demonstrated an overall accuracy of 80.3% for the HER2 scores when compared to the GT. When using different cutoffs for binary classification the resulting performance was: for 0 vs 1+/2+/3+ Kappa was 0.800; 0/1+ vs 2+/3+ Kappa was 0.728; for 0/1+/2+ vs 3+ Kappa was 0.954. The Quadratic Kappa between the AI score and the GT was 0.898, which is considered almost perfect. The performance of the AI was similar across the different laboratories and diagnoses(e.g. IDC, ILC). Conclusion: This study reports the successful development and independent validation of a fully automatic AI-based solution for accurate HER2 scoring in breast cancer. AI solutions, such as the one reported here, could be used as decision-support tools for pathologists in routine clinical practice, enhancing the reproducibility and consistency of HER2 scoring, thus enabling optimal treatment pathways and better patient outcomes. Accurate and automatic IHC scoring solutions can also contribute to the development of new prognostic, predictive and companion diagnostic tools. Citation Format: Yuval Globerson, Lilach Bien, Jonathan Harel, Giuseppe Mallel, Geraldine Sebag, Michel Vandenberghe, Craig Barker, Tsuyoshi Matsuo, Charo Garrido, Judith Sandbank, Chaim Linhart. A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl) nr P6-04-05.

Assessment of Automated Image Analysis of Breast Cancer Tissue Microarrays for Epidemiologic Studies

Reliability of a computational platform as a surrogate for manually interpreted immunohistochemical markers in breast tumor tissue microarrays

Artificial Intelligence Algorithms to Assess Hormonal Status From Tissue Microarrays in Patients With Breast Cancer

Integrated tumor identification and automated scoring minimizes pathologist involvement and provides new insights to key biomarkers in breast cancer

Abstract P6-04-05: A fully automatic artificial intelligence system for accurate and reproducible HER2 IHC scoring in breast cancer

Abstract PO3-07-03: Development & Validation of an AI-supported Workflow for Clinical Scoring of HER2, ER, PR & Ki67 Immunohistochemistry in Breast Cancer Tissue

An Advanced Automated Image Analysis Model For Scoring Of Er, Pr, Her-2 And Ki-67 In Breast Carcinoma

Fully Automated Artificial Intelligence Solution for Human Epidermal Growth Factor Receptor 2 Immunohistochemistry Scoring in Breast Cancer: A Multireader Study

Reliability and Variability of Ki-67 Digital Image Analysis Methods for Clinical Diagnostics in Breast Cancer

High‐throughput protein expression analysis using tissue microarray technology of a large well‐characterised series identifies biologically distinct classes of breast cancer confirming recent cDNA expression analyses

Tissue microarrays and quantitative tissue-based image analysis as a tool for oncology biomarker and diagnostic development

Utility of Immunohistochemistry Tissue Array in the Prediction of Epithelial Ovarian Carcinoma Response to Therapy

Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer: A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer

Concordance between ER, PR, Ki67, and HER2‐low expression in breast cancer by MammaTyper RT‐qPCR and immunohistochemistry: implications for the practising pathologist

Exploring expression levels of HER2, HER3, MET, Claudin18.2, and MUC16 across 16 cancer types using an artificial intelligence-powered immunohistochemistry analyzer.

Abstract 4948: Automated tumor microenvironment analysis for multiple samples by image-based spatial transcriptomics on tissue microarray

Quantitative analysis of breast cancer tissue composition and associations with tumor subtype

Comprehensive and Accurate Molecular Profiling of Breast Cancer through mRNA Expression of ESR1, PGR, ERBB2, MKI67, and a Novel Proliferation Signature

Automated Scoring System of HER2 in Pathological Images under the Microscope

Abstract B092: Development of predictive models for expression of a tumor specific biomarker and CD3 on H&E digital slides

BRCA1 protein expression and subcellular localization in primary breast cancer: Automated digital microscopy analysis of tissue microarrays