AbetaPP, apoptosis and Alzheimer's disease.

S. Pimplikar

Abstract:

What problem does this paper attempt to address?

Development of an automated combined positive score prediction pipeline using artificial intelligence on multiplexed immunofluorescence images

Abhishek Vahadane,Shreya Sharma,Devraj Mandal,Madan Dabbeeru,Josephine Jakthong,Miguel Garcia-Guzman,Shantanu Majumdar,Chung-Wein Lee

DOI: https://doi.org/10.1016/j.compbiomed.2022.106337

Abstract:Immunotherapy targeting immune checkpoint proteins, such as programmed cell death ligand 1 (PD-L1), has shown impressive outcomes in many clinical trials but only 20%-40% of patients benefit from it. Utilizing Combined Positive Score (CPS) to evaluate PD-L1 expression in tumour biopsies to identify patients with the highest likelihood of responsiveness to anti-PD-1/PD-L1 therapy has been approved by the Food and Drug Administration for several solid tumour types. Current CPS workflow requires a pathologist to manually score the two-colour PD-L1 chromogenic immunohistochemistry image. Multiplex immunofluorescence (mIF) imaging reveals the expression of an increased number of immune markers in tumour biopsies and has been used extensively in immunotherapy research. Recent rapid progress of Artificial Intelligence (AI)-based imaging analysis, particularly Deep Learning, provides cost effective and high-quality solutions to healthcare. In this article, we propose an imaging pipeline that utilizes three-colour mIF images (DAPI, PD-L1, and Pan-cytokeratin) as input and predicts the CPS using AI techniques. Our novel pipeline is composed of three modules employing algorithms of image processing, machine learning, and deep learning techniques. The first module of quality check (QC) detects and removes the image regions contaminated with sectioning and staining artefacts. The QC module ensures that only image regions free of the three common artefacts are used for downstream analysis. The second module of nuclear segmentation uses deep learning to segment and count nuclei in the DAPI images wherein our specialized method can accurately separate touching nuclei. The third module of cell phenotyping calculates CPS by identifying and counting PD-L1 positive cells and tumour cells. These modules are data-efficient and require only few manual annotations for training purposes. Using tumour biopsies from a clinical trial, we found that the CPS from the AI-based models shows a high Spearman correlation (78%, p = 0.003) to the pathologist-scored CPS.
Automated tumor proportion score analysis for PD-L1 (22C3) expression in lung squamous cell carcinoma

Jingxin Liu,Qiang Zheng,Xiao Mu,Yanfei Zuo,Bo Xu,Yan Jin,Yue Wang,Hua Tian,Yongguo Yang,Qianqian Xue,Ziling Huang,Lijun Chen,Bin Gu,Xianxu Hou,Linlin Shen,Yan Guo,Yuan Li

DOI: https://doi.org/10.1038/s41598-021-95372-1

IF: 4.6

2021-08-05

Scientific Reports

Abstract:Abstract Programmed cell death ligend-1 (PD-L1) expression by immunohistochemistry (IHC) assays is a predictive marker of anti-PD-1/PD-L1 therapy response. With the popularity of anti-PD-1/PD-L1 inhibitor drugs, quantitative assessment of PD-L1 expression becomes a new labor for pathologists. Manually counting the PD-L1 positive stained tumor cells is an obviously subjective and time-consuming process. In this paper, we developed a new computer aided Automated Tumor Proportion Scoring System (ATPSS) to determine the comparability of image analysis with pathologist scores. A three-stage process was performed using both image processing and deep learning techniques to mimic the actual diagnostic flow of the pathologists. We conducted a multi-reader multi-case study to evaluate the agreement between pathologists and ATPSS. Fifty-one surgically resected lung squamous cell carcinoma were prepared and stained using the Dako PD-L1 (22C3) assay, and six pathologists with different experience levels were involved in this study. The TPS predicted by the proposed model had high and statistically significant correlation with sub-specialty pathologists’ scores with Mean Absolute Error (MAE) of 8.65 (95% confidence interval (CI): 6.42–10.90) and Pearson Correlation Coefficient (PCC) of 0.9436 ( $$p < 0.001$$ p < 0.001 ), and the performance on PD-L1 positive cases achieved by our method surpassed that of non-subspecialty and trainee pathologists. Those experimental results indicate that the proposed automated system can be a powerful tool to improve the PD-L1 TPS assessment of pathologists.

multidisciplinary sciences
Automated tumor proportion scoring for PD-L1 expression based on multistage ensemble strategy in non-small cell lung cancer

Boju Pan,Yuxin Kang,Yan Jin,Lin Yang,Yushuang Zheng,Lei Cui,Jian Sun,Jun Feng,Yuan Li,Lingchuan Guo,Zhiyong Liang

DOI: https://doi.org/10.1186/s12967-021-02898-z

IF: 8.44

2021-06-07

Journal of Translational Medicine

Abstract:Abstract Introduction Programmed cell death ligand-1 (PD-L1) expression is a promising biomarker for identifying treatment related to non-small cell lung cancer (NSCLC). Automated image analysis served as an aided PD-L1 scoring tool for pathologists to reduce inter- and intrareader variability. We developed a novel automated tumor proportion scoring (TPS) algorithm, and evaluated the concordance of this image analysis algorithm with pathologist scores. Methods We included 230 NSCLC samples prepared and stained using the PD-L1(SP263) and PD-L1(22C3) antibodies separately. The scoring algorithm was based on regional segmentation and cellular detection. We used 30 PD-L1(SP263) slides for algorithm training and validation. Results Overall, 192 SP263 samples and 117 22C3 samples were amenable to image analysis scoring. Automated image analysis and pathologist scores were highly concordant [intraclass correlation coefficient (ICC) = 0.873 and 0.737]. Concordances at moderate and high cutoff values were better than at low cutoff values significantly. For SP263 and 22C3, the concordances in squamous cell carcinomas were better than adenocarcinomas (SP263 ICC = 0.884 vs 0.783; 22C3 ICC = 0.782 vs 0.500). In addition, our automated immune cell proportion scoring (IPS) scores achieved high positive correlation with the pathologists TPS scores. Conclusions The novel automated image analysis scoring algorithm permitted quantitative comparison with existing PD-L1 diagnostic assays and demonstrated effectiveness by combining cellular and regional information for image algorithm training. Meanwhile, the fact that concordances vary in different subtypes of NSCLC samples, which should be considered in algorithm development.

medicine, research & experimental
Artificial Intelligence-Assisted Score Analysis for Predicting the Expression of the Immunotherapy Biomarker PD-L1 in Lung Cancer

Guoping Cheng,Fuchuang Zhang,Yishi Xing,Xingyi Hu,He Zhang,Shiting Chen,Mengdao Li,Chaolong Peng,Guangtai Ding,Dadong Zhang,Peilin Chen,Qingxin Xia,Meijuan Wu

DOI: https://doi.org/10.3389/fimmu.2022.893198

2022-07-01

Abstract:Programmed cell death ligand 1 (PD-L1) is a critical biomarker for predicting the response to immunotherapy. However, traditional quantitative evaluation of PD-L1 expression using immunohistochemistry staining remains challenging for pathologists. Here we developed a deep learning (DL)-based artificial intelligence (AI) model to automatically analyze the immunohistochemical expression of PD-L1 in lung cancer patients. A total of 1,288 patients with lung cancer were included in the study. The diagnostic ability of three different AI models (M1, M2, and M3) was assessed in both PD-L1 (22C3) and PD-L1 (SP263) assays. M2 and M3 showed improved performance in the evaluation of PD-L1 expression in the PD-L1 (22C3) assay, especially at 1% cutoff. Highly accurate performance in the PD-L1 (SP263) was also achieved, with accuracy and specificity of 96.4 and 96.8% in both M2 and M3, respectively. Moreover, the diagnostic results of these three AI-assisted models were highly consistent with those from the pathologist. Similar performances of M1, M2, and M3 in the 22C3 dataset were also obtained in lung adenocarcinoma and lung squamous cell carcinoma in both sampling methods. In conclusion, these results suggest that AI-assisted diagnostic models in PD-L1 expression are a promising tool for improving the efficiency of clinical pathologists.
AI based PD-L1 CPS quantifier software to identify more patients for checkpoint therapy in gastric cancer at pathologist-level interobserver concordance.

Sunil S Badve,George Louis Kumar,Tobias Lang,David Mulder,Diego Calvopiña,Patrick Frey,Maria Karasarides

DOI: https://doi.org/10.1200/jco.2024.42.16_suppl.2633

IF: 45.3

2024-06-01

Journal of Clinical Oncology

Abstract:2633 Background: To determine whether gastric cancer (GC) patients are eligible for immunotherapy, PD-L1 expression is analyzed by immunohistochemistry (IHC) using the “Combined Positive Score” (CPS). This requires quantification of PD-L1 stained tumor and tumor-associated immune cells as well as all viable tumor cells. However, manual CPS scoring on whole-slide images (WSIs) is time-consuming and prone to error as evidenced by low interobserver concordance. While the use of artificial intelligence (AI) holds the promise to ameliorate this key challenge in clinical practice, AI models have not yet met the required accuracy thresholds for PD-L1 CPS scoring on GC biopsies. Methods: We investigated the use of an AI-based PD-L1 CPS quantifier software to support pathologists in standardized PD-L1 IHC assessment on GC biopsies.An AI software for automated PD-L1 CPS scoring was deployed on WSIs from GC biopsies (n = 97) stained for PD-L1 with the 28-8 pharmDx assay and scanned on a 3DHistech P1000 scanner. Manual CPS scores from 12 pathologists on all 97 slides were available for comparison. Pairwise correlation was calculated for continuous values using Lin’s concordance correlation coefficient (CCC). Pairwise concordance was measured for scores binarized at the clinically relevant positivity cutoff of CPS ≥ 5 using unweighted Cohen’s kappa. Results: For continuous CPS scores, the CCC between AI scores and pathologists’ scores was higher (0.59) than the mean correlation among pathologists (0.56). In the majority of cases, the AI scores were found to be within the range of all pathologists, but slightly above the pathologist median. At a cutoff of CPS≥5, the concordance between AI scores and pathologists’ manual scores (κ=0.45) was higher than the mean concordance among pathologists’ manual scores (κ=0.39) (p 50% more) categorized as positive by the AI model. Conclusions: An AI model for the assessment of PD-L1 expression in GC using CPS was applied successfully without human intervention. The correlation in continuous CPS scores as well as the concordance in clinical categories with all pathologists was higher for the AI model than for individual pathologists on average, while at the same time, the AI model found more positive patients. This shows that by using AI more positive patients eligible for PD-L1 targeted treatment might be identified while simultaneously ensuring a level of concordance that is non-inferior to pathologists.

oncology
Abstract 471: AIM PD-L1-NSCLC: Artificial intelligence-powered PD-L1 quantification for accurate prediction of tumor proportion score in diverse, multi-stain clinical tissue samples

Michael Griffin,Mevlana Gemici,Ashar Javed,Nishant Agrawal,Murray Resnick,Limin Yu,Sara Hoffman,Victoria Mountain,Jamie Harisiades,Megan Rothney,Benjamin Glass,Ilan Wapinski,Andrew Beck,Eric Walk

DOI: https://doi.org/10.1158/1538-7445.am2022-471

IF: 11.2

2022-06-17

Cancer Research

Abstract:Introduction: Important immunotherapy drugs targeting PD-L1 are approved for first and second line treatment for various stages of NSCLC. Reproducible and precise evaluation of PD-L1 expression is essential to accurately evaluate patients' eligibility for treatment and for enrollment in clinical trials. Current guidelines rely on pathologists to interpret tumor samples, which is challenging in part because different PD-L1 assays have distinct scoring criteria. As a result, determining eligibility by manual assessment can be inconsistent and inaccurate, leading to untreated patients. To support pathologist quantification of PD-L1 in clinical trials, PathAI has developed scanner-and antibody-agnostic machine learning (ML) models, AI-based histologist measurement of PD-L1 in NSCLC (AIM-PD-L1-NSCLC), for the quantification of PD-L1 expression in NSCLC using four PD-L1 immunohistochemistry (IHC) clones. Methods: AIM-PD-L1-NSCLC was trained using convolutional neural networks to identify and quantify PD-L1-positive cells in digitized whole slide images (WSI) of tissue samples. Models were developed using over 5,000 diverse clinical biopsies and resections, including primary and metastatic adenocarcinoma and squamous cell carcinoma samples collected from 10 clinical trials and from two clinical laboratories, each stained for PD-L1 with one of four IHC clones: SP263 (N=1,320), SP142 (N=1,829) (both Ventana Medical Systems Inc., Tucson, AZ), 28-8 (N=1,331), or 22C3 (N=843) (both Agilent Technologies, Santa Clara, USA). Slides were digitized using Aperio, Philips, and Ventana scanners, and WSI were split into training (N=3,818) and test (N=1,505) datasets. The training dataset was annotated by board certified pathologists (313,770 annotations) to label tissue regions and cells. Human Interpretable features representing the number of tumor cells were automatically extracted from the model and a slide level Tumor Proportion Score (TPS) calculated as the proportion of PD-L1+ cancer cells divided by total cancer cells in tumor regions. Model predicted slide level TPS were compared with the median TPS of five pathologists' scores using intraclass correlation coefficient (ICC) statistics. Results: There was high concordance between ML model-predicted and median pathologists' slide level TPS for all PD-L1 clones (ICC 0.93 (95% CI 0.90-0.94), and for each individual clone: 22C3 ICC 0.93 (95% CI 0.89-0.96); SP142 ICC 0.88 (95% CI 0.79-0.93); SP263 ICC 0.96 (95% CI 0.93-0.97; 28-8 ICC 0.90 (95% CI 0.85-0.93). Conclusions: AIM PD-L1 NSCLC is highly concordant with the gold standard pathologist consensus score across four PD-L1 clones in a large diverse dataset. This model could support patient enrollment and stratification in prospective clinical trials, as well as quality control of staining and pathology drift. Citation Format: Michael Griffin, Mevlana Gemici, Ashar Javed, Nishant Agrawal, Murray Resnick, Limin Yu, Sara Hoffman, Victoria Mountain, Jamie Harisiades, Megan Rothney, Benjamin Glass, Ilan Wapinski, Andrew Beck, Eric Walk. AIM PD-L1-NSCLC: Artificial intelligence-powered PD-L1 quantification for accurate prediction of tumor proportion score in diverse, multi-stain clinical tissue samples [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2022; 2022 Apr 8-13. Philadelphia (PA): AACR; Cancer Res 2022;82(12_Suppl) nr 471.

oncology
A New AI-assisted Scoring System for PD-L1 expression in NSCLC

Ziling Huang,Lijun Chen,Lei Lv,Chi-Cheng Fu,Yan Jin,Qiang Zheng,Boyang Wang,Qiuyi Ye,Qu Fang,Yuan Li

DOI: https://doi.org/10.1016/j.cmpb.2022.106829

IF: 6.1

2022-04-01

Computer Methods and Programs in Biomedicine

Abstract:Background: Artificial intelligence (AI) analysis may serve as a scoring tool for programmed cell death ligand-1 (PD-L1) expression. In this study, a new AI-assisted scoring system for pathologists was tested for non-small cell lung cancer (NSCLC) treatment selection.Methods: PD-L1 expression was evaluated using the tumor proportion score (TPS) categorized into three levels: negative (TPS<1%), low expression (TPS 1-49%), and high expression (TPS ≥50%). In order to train, validate, and test the Aitrox AI segmentation model at the whole slide image (WSI) level, 54, 53, and 115 cases were used as training, validation, and test datasets, respectively. TPS reading results from five experienced pathologists, six inexperienced and the Aitrox AI model were analyzed on 115 PD-L1 stained WSIs. The Gold Standard for TPS was derived from the review of three expert pathologists. Spearman's correlation coefficient was calculated and compared between the results.Results: Aitrox AI Model correlated strongly with the TPS Gold Standard and comparable with results of three of the five experienced pathologists. In contrast, the results of four of the six inexperienced pathologists correlated only moderately with the TPS Gold Standard. Aitrox AI Model performed better than the inexperienced pathologists and was comparable to experienced pathologists in both negative and low TPS groups. Despite the fact that the low TPS group showed 5.09% of cases with large fluctuations, the Aitrox AI Model still showed higher correlation than the inexperienced pathologists. However, AI model showed unsatisfactory performance in the high TPS groups, especially lower values than the Gold Standard in images with large regions of false-positive cells.Conclusion: The Aitrox AI Model demonstrates potential in assisting routine diagnosis of NSCLC by pathologists through scoring of PD-L1 expression.

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods
Artificial intelligence-assisted system for precision diagnosis of PD-L1 expression in non-small cell lung cancer

Jianghua Wu,Changling Liu,Xiaoqing Liu,Wei Sun,Linfeng Li,Nannan Gao,Yajun Zhang,Xin Yang,Junjie Zhang,Haiyue Wang,Xinying Liu,Xiaozheng Huang,Yanhui Zhang,Runfen Cheng,Kaiwen Chi,Luning Mao,Lixin Zhou,Dongmei Lin,Shaoping Ling

DOI: https://doi.org/10.1038/s41379-021-00904-9

IF: 8.209

2021-09-13

Modern Pathology

Abstract:Standardized programmed death-ligand 1 (PD-L1) assessment in non-small cell lung cancer (NSCLC) is challenging, owing to inter-observer variability among pathologists and the use of different antibodies. There is a strong demand for the development of an artificial intelligence (AI) system to obtain high-precision scores of PD-L1 expression in clinical diagnostic scenarios. We developed an AI system using whole slide images (WSIs) of the 22c3 assay to automatically assess the tumor proportion score (TPS) of PD-L1 expression based on a deep learning (DL) model of tumor detection. Tests were performed to show the diagnostic ability of the AI system in the 22c3 assay to assist pathologists and the reliability of the application in the SP263 assay. A robust high-performance DL model for automated tumor detection was devised with an accuracy and specificity of 0.9326 and 0.9641, respectively, and a concrete TPS value was obtained after tumor cell segmentation. The TPS comparison test in the 22c3 assay showed strong consistency between the TPS calculated with the AI system and trained pathologists (R = 0.9429–0.9458). AI-assisted diagnosis test confirmed that the repeatability and efficiency of untrained pathologists could be improved using the AI system. The Ventana PD-L1 (SP263) assay showed high consistency in TPS calculations between the AI system and pathologists (R = 0.9787). In conclusion, a high-precision AI system is proposed for the automated TPS assessment of PD-L1 expression in the 22c3 and SP263 assays in NSCLC. Our study also indicates the benefits of using an AI-assisted system to improve diagnostic repeatability and efficiency for pathologists.

pathology
Computer-assisted three-dimensional quantitation of programmed death-ligand 1 in non-small cell lung cancer using tissue clearing technology

Yen-Yu Lin,Lei-Chi Wang,Yu-Han Hsieh,Yu-Ling Hung,Yung-An Chen,Yu-Chieh Lin,Yen-Yin Lin,Teh-Ying Chou

DOI: https://doi.org/10.1186/s12967-022-03335-5

IF: 8.44

2022-03-16

Journal of Translational Medicine

Abstract:Abstract Immune checkpoint blockade therapy has revolutionized non-small cell lung cancer treatment. However, not all patients respond to this therapy. Assessing the tumor expression of immune checkpoint molecules, including programmed death-ligand 1 (PD-L1), is the current standard in predicting treatment response. However, the correlation between PD-L1 expression and anti-PD-1/PD-L1 treatment response is not perfect. This is partly caused by tumor heterogeneity and the common practice of assessing PD-L1 expression based on limited biopsy material. To overcome this problem, we developed a novel method that can make formalin-fixed, paraffin-embedded tissue translucent, allowing three-dimensional (3D) imaging. Our protocol can process tissues up to 150 μm in thickness, allowing anti-PD-L1 staining of the entire tissue and producing high resolution 3D images. Compared to a traditional 4 μm section, our 3D image provides 30 times more coverage of the specimen, assessing PD-L1 expression of approximately 10 times more cells. We further developed a computer-assisted PD-L1 quantitation method to analyze these images, and we found marked variation of PD-L1 expression in 3D. In 5 of 33 needle-biopsy-sized specimens (15.2%), the PD-L1 tumor proportion score (TPS) varied by greater than 10% at different depth levels. In 14 cases (42.4%), the TPS at different depth levels fell into different categories (< 1%, 1–49%, or ≥ 50%), which can potentially influence treatment decisions. Importantly, our technology permits recovery of the processed tissue for subsequent analysis, including histology examination, immunohistochemistry, and mutation analysis. In conclusion, our novel method has the potential to increase the accuracy of tumor PD-L1 expression assessment and enable precise deployment of cancer immunotherapy.

medicine, research & experimental
Scoring PD-L1 Expression in Urothelial Carcinoma: An International Multi-Institutional Study on Comparison of Manual and Artificial Intelligence Measurement Model (AIM-PD-L1) Pathology Assessments

Josef Rüschoff,George Kumar,Sunil Badve,Bharat Jasani,Emma Krause,Nathalie Rioux-Leclercq,Federico Rojo,Maurizio Martini,Liang Cheng,Maria Tretiakova,Catherine Mitchell,Robert A. Anders,Marie E. Robert,Darren Fahy,Mike Pyle,Quang Le,Limin Yu,Benjamin Glass,Vipul Baxi,Zulfia Babadjanova,James Pratt,Sergine Brutus,Maria Karasarides,Arndt Hartmann

DOI: https://doi.org/10.1007/s00428-024-03795-8

2024-04-05

Virchows Archiv

Abstract:Assessing programmed death ligand 1 (PD-L1) expression on tumor cells (TCs) using Food and Drug Administration-approved, validated immunoassays can guide the use of immune checkpoint inhibitor (ICI) therapy in cancer treatment. However, substantial interobserver variability has been reported using these immunoassays. Artificial intelligence (AI) has the potential to accurately measure biomarker expression in tissue samples, but its reliability and comparability to standard manual scoring remain to be evaluated. This multinational study sought to compare the %TC scoring of PD-L1 expression in advanced urothelial carcinoma, assessed by either an AI Measurement Model (AIM-PD-L1) or expert pathologists. The concordance among pathologists and between pathologists and AIM-PD-L1 was determined. The positivity rate of ≥ 1%TC PD-L1 was between 20–30% for 8/10 pathologists, and the degree of agreement and scoring distribution for among pathologists and between pathologists and AIM-PD-L1 was similar both scored as a continuous variable or using the pre-defined cutoff. Numerically higher score variation was observed with the 22C3 assay than with the 28–8 assay. A 2-h training module on the 28–8 assay did not significantly impact manual assessment. Cases exhibiting significantly higher variability in the assessment of PD-L1 expression (mean absolute deviation > 10) were found to have patterns of PD-L1 staining that were more challenging to interpret. An improved understanding of sources of manual scoring variability can be applied to PD-L1 expression analysis in the clinical setting. In the future, the application of AI algorithms could serve as a valuable reference guide for pathologists while scoring PD-L1.

pathology
Non-invasive measurement of PD-L1 status and prediction of immunotherapy response using deep learning of PET/CT images

Wei Mu,Lei Jiang,Yu Shi,Ilke Tunali,Jhanelle E Gray,Evangelia Katsoulakis,Jie Tian,Robert J Gillies,Matthew B Schabath

DOI: https://doi.org/10.1136/jitc-2020-002118

IF: 12.469

2021-06-01

Journal for ImmunoTherapy of Cancer

Abstract:Background Currently, only a fraction of patients with non-small cell lung cancer (NSCLC) treated with immune checkpoint inhibitors (ICIs) experience a durable clinical benefit (DCB). According to NCCN guidelines, Programmed death-ligand 1 (PD-L1) expression status determined by immunohistochemistry (IHC) of biopsies is the only clinically approved companion biomarker to trigger the use of ICI therapy. Based on prior work showing a relationship between quantitative imaging and gene expression, we hypothesize that quantitative imaging (radiomics) can provide an alternative surrogate for PD-L1 expression status in clinical decision support. Methods 18 F-FDG-PET/CT images and clinical data were curated from 697 patients with NSCLC from three institutions and these were analyzed using a small-residual-convolutional-network (SResCNN) to develop a deeply learned score (DLS) to predict the PD-L1 expression status. This developed model was further used to predict DCB, progression-free survival (PFS), and overall survival (OS) in two retrospective and one prospective test cohorts of ICI-treated patients with advanced stage NSCLC. Results The PD-L1 DLS significantly discriminated between PD-L1 positive and negative patients (area under receiver operating characteristics curve ≥0.82 in the training, validation, and two external test cohorts). Importantly, the DLS was indistinguishable from IHC-derived PD-L1 status in predicting PFS and OS, suggesting the utility of DLS as a surrogate for IHC. A score generated by combining the DLS with clinical characteristics was able to accurately (C-indexes of 0.70–0.87) predict DCB, PFS, and OS in retrospective training, prospective testing and external validation cohorts. Conclusion Hence, we propose DLS as a surrogate or substitute for IHC-determined PD-L1 measurement to guide individual pretherapy decisions pending in larger prospective trials.

oncology,immunology
Abstract PO5-07-02: AI-assisted interpretation of PD-L1 CPS improves the precision medicine in Triple-negative breast cancer

Jinze Li,Xinran Wang,Yueping Liu

DOI: https://doi.org/10.1158/1538-7445.sabcs23-po5-07-02

IF: 11.2

2024-05-03

Cancer Research

Abstract:Objective: The IMpassion 031 and KEYNOTE-355 clinical trial demonstrated the advantages of atezolizumab and pembrolizumab in the treatment of Triple-negative breast cancer (TNBC). However, the application of CPS in assessing PD-L1 expression is challenging. Pathologists have great variability in interpretation of PD-L1 CPS, the daily diagnostic workload is too heavy and their diagnostic efficiency is low, and they still have deficiencies in terms of accurate enumeration. It is of necessity to establish an objective and effective method which is highly repeatable. Methods: In this study, we established a deep learning-based artificial intelligence-assisted (AI-assisted) model which using cell detection and region segmentation algorithm. Three rounds of ring studies (RSs) were conducted. 12 pathologists of different level evaluate the CPS of PD-L1 (DAKO 22C3) in TNBC patients by visual assessment and AI-assisted model. Compare the difference, consistency and accuracy of the interpretation. Our research evaluated PD-L1 CPS expression with continuous score. Shapiro-Wilk (S-W) method performs normality test, difference analysis using Friedman M and Bonferroni calibration tests, consistency analysis is studied by intraclass correlation coefficient (ICC) and heat maps and box plots. Results: In the visual assessment, the interpretation results of PD-L1 (DAKO 22C3) CPS in different level pathologists have significant differences (P < 0.05), and the consistency of all the pathologists interpretation results was weak. Due to this strong inconsistency, it may result in a number of patients losing the opportunity to use ICIs for treatment. Moreover, the internal consistency of all pathologists in the visual assessment is moderate, in which the repeatability of junior pathologists is the worst, the ICC value is 0.664 (95%CI: 0.564-0.762). Through AI-assisted interpretation, there is no significant difference between all pathologists (P = 0.425), and the ICC value increased to 0.883 (95%CI:0.836-0.922) which improved the consistency of the interpretation results. In addition, through AI-assisted interpretation, the repeatability and accuracy of the interpretation results has been further upgraded. At the same time, the acceptance of AI results by junior pathologists are high, and 80% of the AI results are accepted. Conclusions: With the help of the AI-assisted diagnostic model, different levels of all the pathologists have achieved excellent consistency and repeatability in the interpretation of PD-L1 (DAKO 22C3) CPS. Moreover, the level of interpretation has been sought the rapid enhancement. It can be seen that AI-assisted diagnostic model provides a good approach to strengthen the consistency and repeatability in clinical practice. Our research also shows that PD-L1 CPS can receive precise interpretation from pathologists, so more patients have the opportunity to use ICIs. Therefore, these patients can benefit from treatment and achieve better survival. The interpretation results and system diagram of PD-L1 CPS by AI-assisted model. The consistency and repeatability of the interpretation results. (A)-(C) The consistency of the PD-L1 CPS interpretation among the different level of pathologists in three ring studies. (D)The repeatability of the interpretation results between 12 pathologists in RS1 and RS2. Accuracies and acceptance rates of different experienced pathologists. (A) Boxplots of scoring accuracies for pathologists in different levels. (B) Acceptance rates of all pathologists in total 50 slides. (C) Percent stacked column chart of different levels of pathologists with AI score acceptance. Citation Format: Jinze Li, Xinran Wang, Yueping Liu. AI-assisted interpretation of PD-L1 CPS improves the precision medicine in Triple-negative breast cancer [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl) nr PO5-07-02.

oncology
Automated PD-L1 Scoring Using Artificial Intelligence in Head and Neck Squamous Cell Carcinoma

Behrus Puladi,Mark Ooms,Svetlana Kintsler,Khosrow Siamak Houschyar,Florian Steib,Ali Modabber,Frank Hölzle,Ruth Knüchel-Clarke,Till Braunschweig

DOI: https://doi.org/10.3390/cancers13174409

2021-08-31

Cancers

Abstract:Immune checkpoint inhibitors (ICI) represent a new therapeutic approach in recurrent and metastatic head and neck squamous cell carcinoma (HNSCC). The patient selection for the PD-1/PD-L1 inhibitor therapy is based on the degree of PD-L1 expression in immunohistochemistry reflected by manually determined PD-L1 scores. However, manual scoring shows variability between different investigators and is influenced by cognitive and visual traps and could therefore negatively influence treatment decisions. Automated PD-L1 scoring could facilitate reliable and reproducible results. Our novel approach uses three neural networks sequentially applied for fully automated PD-L1 scoring of all three established PD-L1 scores: tumor proportion score (TPS), combined positive score (CPS) and tumor-infiltrating immune cell score (ICS). Our approach was validated using WSIs of HNSCC cases and compared with manual PD-L1 scoring by human investigators. The inter-rater correlation (ICC) between human and machine was very similar to the human-human correlation. The ICC was slightly higher between human-machine compared to human-human for the CPS and ICS, but a slightly lower for the TPS. Our study provides deeper insights into automated PD-L1 scoring by neural networks and its limitations. This may serve as a basis to improve ICI patient selection in the future.

oncology
Deep Semi Supervised Generative Learning for Automated PD-L1 Tumor Cell Scoring on NSCLC Tissue Needle Biopsies

Ansh Kapil,Armin Meier,Aleksandra Zuraw,Keith Steele,Marlon Rebelatto,Günter Schmidt,Nicolas Brieu

DOI: https://doi.org/10.1038/s41598-018-35501-5

2018-06-28

Abstract:The level of PD-L1 expression in immunohistochemistry (IHC) assays is a key biomarker for the identification of Non-Small-Cell-Lung-Cancer (NSCLC) patients that may respond to anti PD-1/PD-L1 treatments. The quantification of PD-L1 expression currently includes the visual estimation of a Tumor Cell (TC) score by a pathologist and consists of evaluating the ratio of PD-L1 positive and PD-L1 negative tumor cells. Known challenges like differences in positivity estimation around clinically relevant cut-offs and sub-optimal quality of samples makes visual scoring tedious and subjective, yielding a scoring variability between pathologists. In this work, we propose a novel deep learning solution that enables the first automated and objective scoring of PD-L1 expression in late stage NSCLC needle biopsies. To account for the low amount of tissue available in biopsy images and to restrict the amount of manual annotations necessary for training, we explore the use of semi-supervised approaches against standard fully supervised methods. We consolidate the manual annotations used for training as well the visual TC scores used for quantitative evaluation with multiple pathologists. Concordance measures computed on a set of slides unseen during training provide evidence that our automatic scoring method matches visual scoring on the considered dataset while ensuring repeatability and objectivity.

Computer Vision and Pattern Recognition
Comparing deep learning and pathologist quantification of cell-level PD-L1 expression in non-small cell lung cancer whole-slide images

Leander van Eekelen,Joey Spronck,Monika Looijen-Salamon,Shoko Vos,Enrico Munari,Ilaria Girolami,Albino Eccher,Balazs Acs,Ceren Boyaci,Gabriel Silva de Souza,Muradije Demirel-Andishmand,Luca Dulce Meesters,Daan Zegers,Lieke van der Woude,Willemijn Theelen,Michel van den Heuvel,Katrien Grünberg,Bram van Ginneken,Jeroen van der Laak,Francesco Ciompi

DOI: https://doi.org/10.1038/s41598-024-57067-1

IF: 4.6

2024-03-28

Scientific Reports

Abstract:Programmed death-ligand 1 (PD-L1) expression is currently used in the clinic to assess eligibility for immune-checkpoint inhibitors via the tumor proportion score (TPS), but its efficacy is limited by high interobserver variability. Multiple papers have presented systems for the automatic quantification of TPS, but none report on the task of determining cell-level PD-L1 expression and often reserve their evaluation to a single PD-L1 monoclonal antibody or clinical center. In this paper, we report on a deep learning algorithm for detecting PD-L1 negative and positive tumor cells at a cellular level and evaluate it on a cell-level reference standard established by six readers on a multi-centric, multi PD-L1 assay dataset. This reference standard also provides for the first time a benchmark for computer vision algorithms. In addition, in line with other papers, we also evaluate our algorithm at slide-level by measuring the agreement between the algorithm and six pathologists on TPS quantification. We find a moderately low interobserver agreement at cell-level level (mean reader-reader F1 score = 0.68) which our algorithm sits slightly under (mean reader-AI F1 score = 0.55) , especially for cases from the clinical center not included in the training set. Despite this, we find good AI-pathologist agreement on quantifying TPS compared to the interobserver agreement (mean reader-reader Cohen's kappa = 0.54, 95% CI 0.26–0.81, mean reader-AI kappa = 0.49, 95% CI 0.27—0.72). In conclusion, our deep learning algorithm demonstrates promise in detecting PD-L1 expression at a cellular level and exhibits favorable agreement with pathologists in quantifying the tumor proportion score (TPS). We publicly release our models for use via the Grand-Challenge platform.

multidisciplinary sciences
Assessment of PD-L1 expression and tumour infiltrating lymphocytes in early-stage non-small cell lung carcinoma with artificial intelligence algorithms

Aida Molero,Susana Hernandez,Marta Alonso,Melina Peressini,Daniel Curto,Fernando Lopez-Rios,Esther Conde

DOI: https://doi.org/10.1136/jcp-2024-209766

2024-10-17

Abstract:Aims: To study programmed death ligand 1 (PD-L1) expression and tumour infiltrating lymphocytes (TILs) in patients with early-stage non-small cell lung carcinoma (NSCLC) with artificial intelligence (AI) algorithms. Methods: The study included samples from 50 early-stage NSCLCs. PD-L1 immunohistochemistry (IHC) stained slides (clone SP263) were scored manually and with two different AI tools (PathAI and Navify Digital Pathology) by three pathologists. TILs were digitally assessed on H&E and CD8 IHC stained sections with two different algorithms (PathAI and Navify Digital Pathology, respectively). The agreement between observers and methods for each biomarker was analysed. For PD-L1, the turn-around time (TAT) for manual versus AI-assisted scoring was recorded. Results: Agreement was higher in tumours with low PD-L1 expression regardless of the approach. Both AI-powered tools identified a significantly higher number of cases equal or above 1% PD-L1 tumour proportion score as compared with manual scoring (p=0.00015), a finding with potential therapeutic implications. Regarding TAT, there were significant differences between manual scoring and AI use (p value <0.0001 for all comparisons). The total TILs density with the PathAI algorithm and the total density of CD8+ cells with the Navify Digital Pathology software were significantly correlated (τ=0.49 (95% CI 0.37, 0.61), p value<0.0001). Conclusions: This preliminary study supports the use of AI algorithms for the scoring of PD-L1 and TILs in patients with NSCLC.
Multi-Institutional Study of Pathologist Reading of the Programmed Cell Death Ligand-1 Combined Positive Score Immunohistochemistry Assay for Gastric or Gastroesophageal Junction Cancer

Patricia Gaule,Diana Agostini-Vulaj,Wei Chen,Zongming Eric Chen,Purva Gopal,Lei Zhao,Mikhail Lisovsky,Xiuli Liu,Jinru Shia,Huamin Wang,Zhaohai Yang,Leena McCann,Jodi Weidler,Michael Bates,Xuchen Zhang,Aileen I. Fernandez,Charles J. Robbins,Robert A. Anders,Andrew M. Bellizzi,Yvonne G. Chan,David L. Rimm

DOI: https://doi.org/10.1016/j.modpat.2023.100128

IF: 8.209

2023-05-01

Modern Pathology

Abstract:The assessment of the expression of programmed cell death ligand-1 (PD-L1) using immunohistochemistry (IHC) has been controversial since its introduction. The methods of assessment and the range of assays and platforms contribute to confusion. Perhaps the most challenging aspect of PD-L1 IHC is the combined positive score (CPS) method of interpretation of IHC results. Although the CPS method is prescribed for more indications than any other PD-L1 scoring system, its reproducibility has never been rigorously assessed. In this study, we collected a series of 108 gastric or gastroesophageal junction cancer cases, stained them using the Food and Drug Administration-approved 22C3 assay, scanned them, and then circulated them to 14 pathologists at 13 institutions for the assessment of interpretative concordance for the CPS system. We found that higher cut points (10 or 20) performed better than a CPS of <1 or >1. We used the Observers Needed to Evaluate Subjective Tests algorithm to assess how the CPS system might perform in the real-world setting and found that the cut points of <1 or >1 showed an overall percent agreement of only 30% among the pathologist raters, with a plateau occurring at 8 raters. The raters performed better at higher cut points. However, the best cut point of <20 versus that of >20 was still disappointing, with a plateau at an overall percent agreement of 70% (at 7 raters). Although there is no ground truth for CPS, we compared the score with quantitative messenger RNA measurement and showed no relationship between the score (at any cut point) and messenger RNA amount. In summary, we showed that CPS shows high subjective variability among pathologist readers and is likely to perform poorly in the real-world setting. This system may be the root cause of the poor specificity and relatively low predictive value of IHC companion diagnostic tests for PD-1 axis therapies that use the CPS system.

pathology
AI-Powered Segmentation of Invasive Carcinoma Regions in Breast Cancer Immunohistochemical Whole-Slide Images

Yiqing Liu,Tiantian Zhen,Yuqiu Fu,Yizhi Wang,Yonghong He,Anjia Han,Huijuan Shi

DOI: https://doi.org/10.3390/cancers16010167

2024-01-01

Cancers

Abstract:Aims: The automation of quantitative evaluation for breast immunohistochemistry (IHC) plays a crucial role in reducing the workload of pathologists and enhancing the objectivity of diagnoses. However, current methods face challenges in achieving fully automated immunohistochemistry quantification due to the complexity of segmenting the tumor area into distinct ductal carcinoma in situ (DCIS) and invasive carcinoma (IC) regions. Moreover, the quantitative analysis of immunohistochemistry requires a specific focus on invasive carcinoma regions. Methods and Results: In this study, we propose an innovative approach to automatically identify invasive carcinoma regions in breast cancer immunohistochemistry whole-slide images (WSIs). Our method leverages a neural network that combines multi-scale morphological features with boundary features, enabling precise segmentation of invasive carcinoma regions without the need for additional H&E and P63 staining slides. In addition, we introduced an advanced semi-supervised learning algorithm, allowing efficient training of the model using unlabeled data. To evaluate the effectiveness of our approach, we constructed a dataset consisting of 618 IHC-stained WSIs from 170 cases, including four types of staining (ER, PR, HER2, and Ki-67). Notably, the model demonstrated an impressive intersection over union (IoU) score exceeding 80% on the test set. Furthermore, to ascertain the practical utility of our model in IHC quantitative evaluation, we constructed a fully automated Ki-67 scoring system based on the model’s predictions. Comparative experiments convincingly demonstrated that our system exhibited high consistency with the scores given by experienced pathologists. Conclusions: Our developed model excels in accurately distinguishing between DCIS and invasive carcinoma regions in breast cancer immunohistochemistry WSIs. This method paves the way for a clinically available, fully automated immunohistochemistry quantitative scoring system.
Artificial intelligence enhances whole‐slide interpretation of PD‐L1 CPS in triple‐negative breast cancer: A multi‐institutional ring study

Jinze Li,Pei Dong,Xinran Wang,Jun Zhang,Meng Zhao,Haocheng Shen,Lijing Cai,Jiankun He,Mengxue Han,Jiaxian Miao,Hongbo Liu,Wei Yang,Xiao Han,Yueping Liu

DOI: https://doi.org/10.1111/his.15205

2024-05-16

Histopathology

Abstract:PD‐L1 (Dako 22C3) CPS interpretation in TNBC imposes great challenges on traditional visual assessment. We thus propose an AI‐assisted model based on deep learning‐enabled whole‐slide analysis, conduct in‐depth ring studies on pathologists with varied expertise levels and report the alleviation of interpretation confusions and clinical applicability of our solution. Background and aims Evaluation of the programmed cell death ligand‐1 (PD‐L1) combined positive score (CPS) is vital to predict the efficacy of the immunotherapy in triple‐negative breast cancer (TNBC), but pathologists show substantial variability in the consistency and accuracy of the interpretation. It is of great importance to establish an objective and effective method which is highly repeatable. Methods We proposed a model in a deep learning‐based framework, which at the patch level incorporated cell analysis and tissue region analysis, followed by the whole‐slide level fusion of patch results. Three rounds of ring studies (RSs) were conducted. Twenty‐one pathologists of different levels from four institutions evaluated the PD‐L1 CPS in TNBC specimens as continuous scores by visual assessment and our artificial intelligence (AI)‐assisted method. Results In the visual assessment, the interpretation results of PD‐L1 (Dako 22C3) CPS by different levels of pathologists have significant differences and showed weak consistency. Using AI‐assisted interpretation, there were no significant differences between all pathologists (P = 0.43), and the intraclass correlation coefficient (ICC) value was increased from 0.618 [95% confidence interval (CI) = 0.524–0.719] to 0.931 (95% CI = 0.902–0.955). The accuracy of interpretation result is further improved to 0.919 (95% CI = 0.886–0.947). Acceptance of AI results by junior pathologists was the highest among all levels, and 80% of the AI results were accepted overall. Conclusion With the help of the AI‐assisted diagnostic method, different levels of pathologists achieved excellent consistency and repeatability in the interpretation of PD‐L1 (Dako 22C3) CPS. Our AI‐assisted diagnostic approach was proved to strengthen the consistency and repeatability in clinical practice.

pathology,cell biology
Reproducibility in PD-L1 Immunohistochemistry Quantification through the Tumor Proportion Score and the Combined Positive Score: Could Dual Immunostaining Help Pathologists?

Anaïs Mercier,Virginie Conan-Charlet,Isabelle Quintin-Roué,Laurent Doucet,Pascale Marcorelles,Arnaud Uguen

DOI: https://doi.org/10.3390/cancers15102768

2023-05-16

Cancers

Abstract:We studied the pathologists' agreements in quantifying PD-L1 expression through the tumor proportion score (TPS) and the combined positive score (CPS) using single PD-L1 immunohistochemistry (S-IHC) and double immunohistochemistry (D-IHC) combining PD-L1 staining and tumor cell markers. S-IHC and D-IHC were applied to 15 cancer samples to generate 60 digital IHC slides (30 whole slides images and 30 regions of interest of 1 mm2) for PD-L1 expression quantification using both TPS and CPS, twice by four pathologists. Agreements were estimated calculating intraclass correlation coefficients (ICC). Both S-IHC and D-IHC slides analyses resulted in excellent (for TPS, ICC > 0.9) to good (for CPS, ICC > 0.75) inter- and intra-pathologist agreements with slightly higher ICC with D-IHC than with S-IHC. S-IHC resulted in higher TPS and CPS than D-IHC (+5.6 and +6.1 mean differences, respectively). High reproducibility in the quantification of PD-L1 expression is attainable using S-IHC and D-IHC.

oncology

AbetaPP, apoptosis and Alzheimer's disease.

Development of an automated combined positive score prediction pipeline using artificial intelligence on multiplexed immunofluorescence images

Automated tumor proportion score analysis for PD-L1 (22C3) expression in lung squamous cell carcinoma

Automated tumor proportion scoring for PD-L1 expression based on multistage ensemble strategy in non-small cell lung cancer

Artificial Intelligence-Assisted Score Analysis for Predicting the Expression of the Immunotherapy Biomarker PD-L1 in Lung Cancer

AI based PD-L1 CPS quantifier software to identify more patients for checkpoint therapy in gastric cancer at pathologist-level interobserver concordance.

Abstract 471: AIM PD-L1-NSCLC: Artificial intelligence-powered PD-L1 quantification for accurate prediction of tumor proportion score in diverse, multi-stain clinical tissue samples

A New AI-assisted Scoring System for PD-L1 expression in NSCLC

Artificial intelligence-assisted system for precision diagnosis of PD-L1 expression in non-small cell lung cancer

Computer-assisted three-dimensional quantitation of programmed death-ligand 1 in non-small cell lung cancer using tissue clearing technology

Scoring PD-L1 Expression in Urothelial Carcinoma: An International Multi-Institutional Study on Comparison of Manual and Artificial Intelligence Measurement Model (AIM-PD-L1) Pathology Assessments

Non-invasive measurement of PD-L1 status and prediction of immunotherapy response using deep learning of PET/CT images

Abstract PO5-07-02: AI-assisted interpretation of PD-L1 CPS improves the precision medicine in Triple-negative breast cancer

Automated PD-L1 Scoring Using Artificial Intelligence in Head and Neck Squamous Cell Carcinoma

Deep Semi Supervised Generative Learning for Automated PD-L1 Tumor Cell Scoring on NSCLC Tissue Needle Biopsies

Comparing deep learning and pathologist quantification of cell-level PD-L1 expression in non-small cell lung cancer whole-slide images

Assessment of PD-L1 expression and tumour infiltrating lymphocytes in early-stage non-small cell lung carcinoma with artificial intelligence algorithms

Multi-Institutional Study of Pathologist Reading of the Programmed Cell Death Ligand-1 Combined Positive Score Immunohistochemistry Assay for Gastric or Gastroesophageal Junction Cancer

AI-Powered Segmentation of Invasive Carcinoma Regions in Breast Cancer Immunohistochemical Whole-Slide Images

Artificial intelligence enhances whole‐slide interpretation of PD‐L1 CPS in triple‐negative breast cancer: A multi‐institutional ring study

Reproducibility in PD-L1 Immunohistochemistry Quantification through the Tumor Proportion Score and the Combined Positive Score: Could Dual Immunostaining Help Pathologists?