Abstract:Abstract Background: Immunohistochemical evaluation of HER2 status, the hormone receptors ER and PR, and the proliferation marker Ki67 forms part of the routine clinical diagnostic pathway for invasive breast carcinomas, and is the cornerstone of treatment stratification, informing both prognosis and patient management. Pathologist scoring of immunohistochemistry (IHC) at the microscope is time-consuming and prone to significant inter- and intra-observer variability. We developed HALO Breast AI, a decision-support system designed to improve efficiency and diagnostic accuracy through automating whole slide image (WSI) scoring. Here, we present preliminary results of a validation study of HALO Breast AI. Methods: HALO Breast AI was developed with routine diagnostic cases sourced from three institutes. The algorithm was trained using 107,755 pathologist-reviewed annotations to identify and threshold DAB-positive tumor cells within automatically segmented tumor regions. Internal validation was conducted on 80 unseen WSI, using 60,012 pathologist-reviewed annotations to assess analytical performance. Comparison of the algorithm scores to the mode of 3 expert pathologists (where at least 2 out of 3 agreed) was used to assess consensus agreement. Clinical performance and generalizability were assessed by comparing the algorithm scores to clinical data from two independent external institutes across 200 unseen WSI (n=50 per marker) from institute one and 300 unseen WSI (n=100 per marker [ ER, PR & HER2, only]) from institute 2. Results: The median image F1-score for tumor classification was 0.91, while the median image F1-score for cell level validation was 0.96. Internal validation showed agreement between HALO Breast AI and the mode of 3 expert pathologists of 100% for ER, 90% for PR, 95% for Ki67 and 90% for HER2. High concordance was measured between the algorithm and the pathologists’ scores, with Light’s kappa of 0.91 for ER, 0.85 for PR, 0.79 for HER2 and 0.82 for Ki67. Performance on WSI obtained from external institute one, showed agreement between the clinical score obtained from HALO Breast AI and the clinical data of 96% for ER, 94% for PR, 84% for HER2 and 84% for Ki67. External institute two showed agreement of 90% for ER, 90% for PR and 83% for HER2. Of the ER & PR cases that were in disagreement at the 1% clinical cut-off, the algorithm percent-positive scores were within a 1-3% range in 5 out of the 5 from institute 1 and 14 out of the 20 from institute 2. So, although on a categorical scale the AI assigned category disagreed with the clinical category, the results were close on a continuous scale. Conclusions: HALO Breast AI accurately detects tumor regions and tumor cells within breast cancer tissue and demonstrates high clinical agreement when scoring routine diagnostic IHC. Additionally, HALO Breast AI shows good generalisability, with a consistently strong performance across inherent variability that exists between external, independent data sets. Computer-aided diagnostic tools such as HALO Breast AI have the potential to support pathologists in the diagnostic setting by improving workflow efficiency and standardising results. Citation Format: Meredith Lodge, Alastair Ironside, Ashley Graham, Antonio Polonia, Stefan Reinhard, Wiebke Solass, Inti Zlobec, Peter Caie. Development & Validation of an AI-supported Workflow for Clinical Scoring of HER2, ER, PR & Ki67 Immunohistochemistry in Breast Cancer Tissue [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl):Abstract nr PO3-07-03.

Comparison of Histological Grade and Biomarker Expression Assessment Using Conventional Light Microscopy, Whole Slide Imaging, and Digital Image Analysis

A Comparison Of Visual Assessment And Automated Digital Image Analysis Of Ki67 Labeling Index In Breast Cancer

Reliability and Variability of Ki-67 Digital Image Analysis Methods for Clinical Diagnostics in Breast Cancer

Semi-automated analysis of HER2 immunohistochemistry in invasive breast carcinoma using whole slide images: utility for interpretation in clinical practice

Intratumoral heterogeneity of Ki67 proliferation index outperforms conventional immunohistochemistry prognostic factors in estrogen receptor-positive HER2-negative breast cancer

Comparison of FDA-Approved vs. Mayo Clinic’s Ki-67 Immunostaining Protocols for Breast Cancer Specimens: A Quantitative Analysis Using Artificial Intelligence (AI) Based Image Analysis Algorithms

Artificial Intelligence Algorithms to Assess Hormonal Status From Tissue Microarrays in Patients With Breast Cancer

Automated imaging analysis of Ki-67 immunohistochemistry on whole slide images of cell blocks from pancreatic neuroendocrine neoplasms

An Interobserver Reproducibility Analysis of Ki67 Visual Assessment in Breast Cancer

Assessment of Ki67 expression for breast cancer subtype classification and prognosis in the Nurses’ Health Study

Comparative analysis of the value of amide proton transfer-weighted imaging and diffusion kurtosis imaging in evaluating the histological grade of cervical squamous carcinoma

Abstract PO3-07-03: Development & Validation of an AI-supported Workflow for Clinical Scoring of HER2, ER, PR & Ki67 Immunohistochemistry in Breast Cancer Tissue

Digital Image Analysis of Ki67 Heterogeneity Improves the Diagnosis and Prognosis of Gastroenteropancreatic Neuroendocrine Neoplasms

Advancing Ki67 hotspot detection in breast cancer: a comparative analysis of automated digital image analysis algorithms

Immunohistochemical assessment of HER2 low breast cancer: interobserver reproducibility and correlation with digital image analysis

Analysis of Tumor Proliferation Markers in Early-Stage Luminal Breast Cancer: A Comprehensive Study Using Mitotic Activity Index, Ki-67, and Phosphohistone H3 Expression

Improving the diagnosis of ductal carcinoma in situ with microinvasion without immunohistochemistry: An innovative method with H&E‐stained and multiphoton microscopy images

Systematically higher Ki67 scores on core biopsy samples compared to corresponding resection specimen in breast cancer: a multi-operator and multi-institutional study

The value of multiple diffusion metrics based on whole-lesion histogram analysis in evaluating the subtypes and proliferation status of non-small cell lung cancer

Image analysis for bright-field HER2 in situ hybridization: validation for clinical use

Artificial intelligence (AI) –powered H&E whole-slide image (WSI) analysis to predict recurrence in hormone receptor positive (HR+) early breast cancer (EBC).