Abstract:AI-based variant effect predictors (VEPs), such as AlphaMissense, which is based on the protein structure prediction method AlphaFold, have gained significant attention for their potential to predict pathogenic effects of mutations. However, the utility of these methods for identifying pathogenic mutations in cancer remains unknown. We sought to quantify the prevalence of variants of unknown significance (VUSs) across the pan-cancer, multi-institution AACR GENIE cohort (N=160,965 samples) and test the utility of VEPs (SIFT, PolyPhen, MutationAssessor, REVEL, CADD, and AlphaMissense), using publicly available mutation annotations from each method, for 1) Annotating known pathogenic somatic cancer variants across the GENIE cohort, using known benign single nucleotide polymorphisms as negative controls 2) Identifying VUSs associated with overall survival (OS) in two cohorts of patients with non-small cell cancer (NSCLC), the MSK-IMPACT NCSLC (N=8,690) and non-MSK AACR GENIE Biopharma Collaborative NSCLC (N=977) cohorts, and 3) Identifying VUSs associated with known genomic patterns of mutual exclusivity in the MSK-IMPACT NSCLC cohort. In the GENIE cohort, 79% of mutations identified were VUSs according to an FDA-recognized molecular knowledge database, with a wide range of VUS frequencies across genes. Among VEPs trained without prior human-annotated knowledge, CADD and AlphaMissense had the highest AUROCs (0.940, 95%CI 0.937-0.943 and 0.917, 95%CI 0.913-0.922 respectively) for predicting known cancer drivers, demonstrating the power of protein structure modeling or functional genomic data for enhancing cancer drivers prediction. All VEPs identified known driver mutations in tumor suppressor genes more accurately than oncogenes, highlighting the challenge in identifying gain-of-function mutations. We tested whether VUSs reclassified as pathogenic by VEPs are associated with prognosis using inverse probability of treatment-weighted Cox's propensity hazard models controlling for tumor mutational burden, treatment history, and other factors. VUSs reclassified as pathogenic by AlphaMissense and other VEPs in KEAP1 and SMARCA4 correlated with worse OS, comparable to that of known oncogenic mutations in those genes. Patients with tumors containing VUSs annotated as benign had similar OS to patients without analogous driver mutations. Finally, VUSs reclassified as oncogenic by AlphaMissense in genes within the RTK/RAS and NRF2 pathways followed expected patterns of mutual exclusivity, further suggesting biological validity. Despite not being trained to predict somatic effects in cancer, AI-derived mutation annotations can broaden the subset of annotated pathogenic variants in cancer and contribute to a more complete understanding of cancer genetics. Real-world outcomes and alteration patterns are additional benchmarks to consider when assessing the utility of VEPs in cancer. Citation Format: Thinh N. Tran, Chris Fong, Karl Pichotta, Anisha Luthra, Ronglai Shen, Yuan Chen, Michele Waters, Susie Kim, Gregory Riely, Debyani Chakravarty, Nikolaus Schultz, Justin Jee. AI-derived predictions improve identification of real-world cancer driver mutations [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular s); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl) nr 1252.

Understanding the heterogeneous performance of variant effect predictors across human protein-coding genes

Understanding the heterogeneous performance of variant effect predictors across human protein-coding genes

Variant effect predictor correlation with functional assays is reflective of clinical classification performance

The Impact of Clinical and Molecular Variant Properties on Calibration and Performance of Variant Effect Prediction Tools

Pervasive ancestry bias in variant effect predictors

Assessment of variant effect predictors unveils variants difficulty as a critical performance indicator

Updated benchmarking of variant effect predictors using deep mutational scanning

Guidelines for releasing a variant effect predictor

Variant scoring performance across selection regimes depends on variant-to-gene and gene-to-disease components

Cross-protein transfer learning substantially improves disease variant prediction

Identifying Factors Important for Conservation at Sites of Synonymous Variations

Using deep mutational scanning to benchmark variant effect predictors and identify disease mutations

Enhancing missense variant pathogenicity prediction with protein language models using VariPred

Enzyme structure correlates with variant effect predictability

VariPred: Enhancing Pathogenicity Prediction of Missense Variants Using Protein Language Models

A Comparison on Predicting Functional Impact of Genomic Variants.

APF2: an improved ensemble method for pharmacogenomic variant effect prediction

Abstract 1252: AI-derived predictions improve identification of real-world cancer driver mutations

Toward Automatic Variant Interpretation: Discordant Genetic Interpretation Across Variant Annotations for ClinVar Pathogenic Variants

TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding Fusion

Using computational approaches to enhance the interpretation of missense variants in the PAX6 gene