Abstract:BackgroundModern machine learning (ML) models based on highly multivariate attribute sets (e.g. unbiased -omics data) can be very successful at generating clinically useful predictions, but at the price of less transparency in how individual attributes are used to make those predictions. In short, ML test algorithms tend to be ”black boxes”. Shapley values (SVs)1 describe the relative importance of the attributes used within a multivariate test to the generation of the test result for an individual patient.2 While typically the calculation of SVs is computationally prohibitive, our ML architecture permits the generation of SVs for large patient cohorts. In this study, we evaluate SVs for the Anti-PD-L1 Response Test (ART), that was shown in independent validation to predict outcomes for patients treated with atezolizumab,3 for the POPLAR Ph2 and OAK Ph3 studies of non-small cell lung cancer (NSCLC) patients .4 5Abstract 831 Figure 1Radar plots illustrating the values of the 10 most important SVs for test classification generation for two samples classified as poor (A and B) and two samples classified as good (C and D). Positive SVs are shown in red and negative SVs are shown in blueAbstract 831 Figure 2Heatmaps of the SVs for samples classified as poor showing two subgroups (top and bottom, separated by horizontal line) with different patterns of SVs for (A) POPLAR and (B) OAKAbstract 831 Figure 3Heatmaps of the SVs for samples classified as good showing three subgroups, top, middle, and bottom, separated by horizontal lines) with different patterns of SVs for (A) POPLAR and (B) OAKMethodsART results, Good or Poor had been produced for 262 patients in POPLAR (NCT01903993) and 786 patients in OAK (NCT02008227). Exact SVs were generated for each pretreatment serum sample for each of the 93 attributes (proteomic features) used in the test. The distribution of SVs across the cohort was investigated to assess the relative importance of each feature to test classification. Subgroups of patients with similar patterns of SVs were identified using t-sne plots and ML methods in the POPLAR cohort and validated in the OAK cohort.ResultsThe SV distributions showed that the features influencing ART classification most were similar in both POPLAR and OAK. The relative importance of features to test classification differed between patients (figure 1), but subgroups of patients within test classification groups showed similar patterns of SVs (figures 2 and 3). Such patient subgroups, identified within POPLAR, were also found in the OAK cohort and were associated with differences in outcome and/or differences in patient characteristics.ConclusionsSVs can explain how complex ML-based tests combine molecular attributes to produce individual patient results. Exact SVs can be obtained for certain ML architectures used in molecular test development, revealing the overall relative importance of attributes used in such molecular tests. Subgrouping of patients with the same test classification by different patterns of SVs is possible. This may reveal different biologies contributing to a Good or Poor phenotype and inform translational studies.Trial RegistrationClinicalTrialsgov NCT01903993 and NCT02008227ReferencesShapley L. A value for n-person games. Contributions to the Theory of Games. 1953;2.28:307–317.Roder J, Maguire L, Georgantas R, Roder H. Explaining multivariate molecular diagnostic tests via Shapley values. BMC Med Inform Decis Mak 2021;21(1):211.Kowanetz M, Leng N, Roder J, et al. Evaluation of immune-related markers in the circulating proteomic and their association with atezolizumab efficacy in patients with 2L+ NSCLC. J Immunother Cancer 2018;6(Suppl1):114.Fehrenbacher L, Spira A, Ballinger M, et al. Atezolizumab versus docetaxel for patients with previously treated non-small-cell lung cancer (POPLAR): a multicentre, open-label, phase 2 randomised controlled trial. Lancet 2016;387(10030):1837–1846.Rittmeyer A, Barlesi F, Waterkamp D, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicenter randomized controlled trial. Lancet 2017;389(10066):255–265.Ethics ApprovalThe OAK study that was done in 194 academic medical centers and community oncology practices across 31 countries worldwide. The study was done in full accordance with the guidelines for Good Clinical Practice and the Declaration of Helsinki. All patients gave written informed consent.The POPLAR trial was done at 61 academic medical centers and community oncology practices across 13 countries in Europe and North America. The study was done in full accordance with the guidelines for Good Clinical Practice and the Declaration of Helsinki. Protocol (and modification) approval was obtained from anindependent ethics committee for each site. Patients gave written informed consent.

Comparison of SP142 and 22C3 Immunohistochemistry PD-L1 Assays for Clinical Efficacy of Atezolizumab in Non–Small Cell Lung Cancer: Results from the Randomized OAK Trial

Comparison of SP263 and 22C3 Immunohistochemistry PD-L1 Assays for Clinical Efficacy of Adjuvant Atezolizumab in Non-Small Cell Lung Cancer: Results from the Randomized Phase III IMpower010 Trial.

PD-L1 Immunohistochemistry Assay Comparison in Atezolizumab Plus nab-Paclitaxel-Treated Advanced Triple-Negative Breast Cancer

Heterogeneity Assessment of Two PD-L1 Clones: 22C3 and SP142 in Patients with Non-Small Cell Lung Cancer (NSCLC).

Concordance among the Three Commercially Available PD-L1 Assays for Esophageal Squamous Cell Carcinoma

28 Predictions of Outcomes and Benefit of Immune Checkpoint Inhibitor Treatment in NSCLC Require Information on Both Tumor and Host Biology

A Phase III Trial to Compare Atezolizumab (atezo) Vs Best Supportive Care (BSC) Following Adjuvant Chemotherapy in Patients (pts) with Completely Resected NSCLC: IMpower010.

26 Validation of the Primary Immune Response (PIR) Test in Advanced Non-Small Cell Lung Cancer (NSCLC): Blinded Retrospective Analyses from the POPLAR and OAK Trials

Comparison of PD-L1 tumor cell expression with 22C3, 28-8, and SP142 IHC assays across multiple tumor types

P3.02c-050 IMpower010: Phase III Study of Atezolizumab Vs BSC after Adjuvant Chemotherapy in Patients with Completely Resected NSCLC

Abstract 1566: Establishment of Analytical Performance Features of Two Immunohistochemistry Assays for PD-L1 Expression in Lung Cancer

PS01.55: IMpower010: Phase III Study of Atezolizumab Vs BSC after Adjuvant Chemotherapy in Patients with Completely Resected NSCLC: Topic: Medical Oncology.

Efficacy And A Novel Clinicopathologic-Genomic Nomogram Of Atezolizumab In Advanced Non-Small Cell Lung Cancer (Poplar And Oak): A Combined Analysis Of Two Multicenter, Randomized, Phase Ii/Iii Trials.

Assessment of Concordance between 22C3 and SP142 Immunohistochemistry Assays regarding PD-L1 Expression in Non-Small Cell Lung Cancer

Atezolizumab Versus Docetaxel for Patients with Previously Treated Non-Small-cell Lung Cancer (POPLAR): a Multicentre, Open-Label, Phase 2 Randomised Controlled Trial.

A Prospective, Multi-institutional, Pathologist-Based Assessment of 4 Immunohistochemistry Assays for PD-L1 Expression in Non–Small Cell Lung Cancer

OA03.03 Phase 2B of Blueprint PD-L1 Immunohistochemistry Assay Comparability Study

Maximum Somatic Allele Frequency In Combination With Blood-Based Tumor Mutational Burden To Predict The Efficacy Of Atezolizumab In Advanced Non-Small Cell Lung Cancer: A Pooled Analysis Of The Randomized Poplar And Oak Studies

Atezolizumab for First-Line Treatment of PD-L1-Selected Patients with NSCLC.

Exact shapley values for explaining complex machine learning based molecular tests of checkpoint inhibitors: potential utility for patients, physicians, and translational research

Comparison of three PD-L1 immunohistochemical assays in head and neck squamous cell carcinoma (HNSCC)