Abstract:Introduction Tertiary lymphoid structures (TLSs) and tumor-infiltrating lymphocytes (TILs) in breast carcinomas are prognostic for survival and predictive of certain therapy responses. The presence of TLSs and TILs are identified by manual pathological examination; however, this method often lacks reproducibility, limiting its use in routine clinical practice. Here, we demonstrate that morphological evaluation of whole slide images (WSIs) using an artificial intelligence (AI)-based analytic workflow comprised of convolutional neural network (CNN) deep learning models that accurately and reproducibly characterizes TILs, measured as the lymphocyte immune-infiltrated area (LIIA), and TLSs in the tumor microenvironment (TME) of breast carcinomas. Methods We collected a cohort of 445 TCGA breast cancer H&E WSIs, including clinical and sequencing data, and divided this cohort into luminal invasive lobular carcinoma (ILC) (n = 192), HER2-enriched (n = 110), and basal-like (n = 143) molecular subtypes. After 55 samples were excluded due to artifacts or incomplete clinical annotation, a total of 390 samples were analyzed. A combination of CNN-based deep learning models was used to detect and classify the tumor area, TLSs present in the TME, TLS density (number of TLS per mm2 of tumor), and lymphocyte-rich regions. The LIIA was calculated as the area of the stromal and TIL components of the TME. Validation was performed by manually annotating 10 random WSIs from the dataset. Spatial model predictions of the tumor and TLSs were combined to identify TLS locations. Each model's predictions were verified by univariate (Kaplan-Meier) and multivariate (Cox regression) survival analyses, and the log-rank test was used to calculate overall survival. Additionally, the relationship between TLSs and LIIAs with CD274 expression (PD-L1) and a high tumor mutational burden (TMB > 10) was analyzed. Statistical analyses included Spearman's rank correlation and Mann-Whitney tests. Results TLS were detected in 53% (n = 207) of the samples, with a mean density of 26.02 TLS/mm2 (Q3 = 5.53 TLS/mm2). TLS density was higher in basal-like subtype samples compared to luminal and HER2-enriched subtypes. While LIIA and TMB-high samples exhibited a significant relationship (p = 0.00001), no significant association was found between TME and TLS quantities or density. PD-L1 gene expression exhibited weak to moderate correlations with predicted LIIA in basal-like (r = 0.38, p = 0.00001) and HER2-enriched subtypes (r = 0.38, p = 0.0001). The luminal subtype had no significant correlation between PD-L1 expression and predicted LIIA. As a result, LIIA and TLS were characterized as positive prognostic factors for the basal-like subtype. After adjusting for age, stage, and grade, the LIIA and TLS density were found to be significant independent positive prognostic overall survival factors for the basal-like subtype (LIIA HR: 0.02, p = 0.003; TLS-high group HR: 0.09, p = 0.002). For the HER2-enriched subtype, TLS density was also a significant predictor (HR: 0.05, p = 0.035), while LIIA was not a statistically significant prognostic factor (HR: 0.0002, p = 0.08). Associations were not observed between the TLSs and LIIA between the ILC subtypes and survival outcomes. The same result was observed for univariate analyses. Conclusion The developed analytic pipeline accurately identified the presence of LIIA and TLS on H&E slides, demonstrating the potential of CNN for automated characterization of the breast cancer TME. AI-based TLS and LIIA quantification can be a robust tool for pathology processes, offering additional information to help in clinical decision-making. This approach can be used to detect features of immune morphology biomarkers in other cancer types. Citation Format: Vladimir Kushnarev, Daniil Dymov, Nadezhda Lukashevich, Lev Popyvanov, Anna Belozerova, Diana Shamsutdinova, Aida Akaeva, Yury Popov, Svetlana Khorkova, Ivan Valiev, Anastasia Zotova, Jessica H. Brown, Anna Love, Alexander Bagaev, Ekaterina Postovalova, Nathan Fowler. AI-based prediction of tertiary lymphoid structures and lymphocyte immune infiltration in breast carcinomas [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl) nr P6-04-15.

Abstract P1-08-05: Educating pathologists in quantitating stromal tumor-infiltrating lymphocytes in breast cancer for artificial intelligence applications

Training pathologists to assess stromal tumour‐infiltrating lymphocytes in breast cancer synergises efforts in clinical care and scientific research

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

AI-based quantification of TILs using hematoxylin and eosin and immunohistochemistry-stained slides in triple-negative breast cancer.

Deep learning-based quantitative assessment of tumor-infiltrating lymphocytes from hematoxylin and eosin-stained slides in triple-negative breast cancer: A prognostic study.

Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer: A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer

Abstract 5444: Integrated analysis of gene expression signatures and AI-based detection of tertiary lymphoid structures and stromal tumor-infiltrating lymphocytes in breast cancer H&E samples

Abstract P6-04-15: AI-based prediction of tertiary lymphoid structures and lymphocyte immune infiltration in breast carcinomas

Automated quantification of stromal tumour infiltrating lymphocytes is associated with prognosis in breast cancer

Abstract 905: ML quantification of tumor-Infiltrating lymphocytes distinguishes immune-phenotypes and reveals phenotypic heterogeneity

Abstract 7399: Development of a reproducible AI-based spatial biomarker of the tumor immune infiltrate on H&E slides

Study of Tumor-Infiltrating Lymphocytes in Breast Carcinoma and Their Association With Pathological and Prognostic Factors and Pathological Tumor-Node-Metastasis (pTNM) Staging

Abstract LB384: Artificial intelligence measures of tumor infiltrating lymphocytes predict colorectal cancer-specific and overall survival

Assessment of stromal tumor-infiltrating lymphocytes in neoadjuvant chemotherapy for invasive breast carcinoma: Predictive insights across molecular subtypes

Abstract 471: AIM PD-L1-NSCLC: Artificial intelligence-powered PD-L1 quantification for accurate prediction of tumor proportion score in diverse, multi-stain clinical tissue samples

Abstract 6181: Digital pathology workflow: Building a bridge for translational biomarker development in humanized mice

Automated scoring methods for quantitative interpretation of Tumour infiltrating lymphocytes (TILs) in breast cancer: a systematic review

Digital Pathology Analysis Quantifies Spatial Heterogeneity of CD3, CD4, CD8, CD20, and FoxP3 Immune Markers in Triple-Negative Breast Cancer

Abstract 1360: Spatial image analysis of tumor-infiltrating lymphocytes on gastric cancer to predict anti-PD1 inhibitor response

Quantitative Whole Slide Assessment of Tumor-Infiltrating CD8-Positive Lymphocytes in ER-Positive Breast Cancer in Relation to Clinical Outcome

Abstract PO3-07-03: Development & Validation of an AI-supported Workflow for Clinical Scoring of HER2, ER, PR & Ki67 Immunohistochemistry in Breast Cancer Tissue