Abstract:The emergence of SARS-CoV-2 variants stressed the demand for tools allowing to interpret the effect of single amino acid variants (SAVs) on protein function. While Deep Mutational Scanning (DMS) sets continue to expand our understanding of the mutational landscape of single proteins, the results continue to challenge analyses. Protein Language Models (pLMs) use the latest deep learning (DL) algorithms to leverage growing databases of protein sequences. These methods learn to predict missing or masked amino acids from the context of entire sequence regions. Here, we used pLM representations (embeddings) to predict sequence conservation and SAV effects without multiple sequence alignments (MSAs). Embeddings alone predicted residue conservation almost as accurately from single sequences as ConSeq using MSAs (two-state Matthews Correlation Coefficient-MCC-for ProtT5 embeddings of 0.596 ± 0.006 vs. 0.608 ± 0.006 for ConSeq). Inputting the conservation prediction along with BLOSUM62 substitution scores and pLM mask reconstruction probabilities into a simplistic logistic regression (LR) ensemble for Variant Effect Score Prediction without Alignments (VESPA) predicted SAV effect magnitude without any optimization on DMS data. Comparing predictions for a standard set of 39 DMS experiments to other methods (incl. ESM-1v, DeepSequence, and GEMME) revealed our approach as competitive with the state-of-the-art (SOTA) methods using MSA input. No method outperformed all others, neither consistently nor statistically significantly, independently of the performance measure applied (Spearman and Pearson correlation). Finally, we investigated binary effect predictions on DMS experiments for four human proteins. Overall, embedding-based methods have become competitive with methods relying on MSAs for SAV effect prediction at a fraction of the costs in computing/energy. Our method predicted SAV effects for the entire human proteome (~ 20 k proteins) within 40 min on one Nvidia Quadro RTX 8000. All methods and data sets are freely available for local and online execution through bioembeddings.com, https://github.com/Rostlab/VESPA , and PredictProtein.

TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding Fusion

Predicting Pathogenic Single Nucleotide Variants Through a Comprehensive Analysis on Multiple Level Features

Enhancing missense variant pathogenicity prediction with protein language models using VariPred

VariPred: Enhancing Pathogenicity Prediction of Missense Variants Using Protein Language Models

Prediction of Human-Virus Protein-Protein Interactions Through a Sequence Embedding-Based Machine Learning Method

TEMPO: A Transformer-Based Mutation Prediction Framework for SARS-CoV-2 Evolution

VF-Pred: Predicting virulence factor using sequence alignment percentage and ensemble learning models

TransPPMP: Predicting Pathogenicity of Frameshift and Non-Sense Mutations by a Transformer Based on Protein Features

FunSAV: Predicting the Functional Effect of Single Amino Acid Variants Using a Two-Stage Random Forest Model

DTVF: A User-Friendly Tool for Virulence Factor Prediction Based on ProtT5 and Deep Transfer Learning Models

Deep Learning Prediction of Ribosome Profiling with Translatomer Reveals Translational Regulation and Interprets Disease Variants

Cross-protein transfer learning substantially improves disease variant prediction

FCMSTrans: Accurate Prediction of Disease-Associated Nssnps by Utilizing Multiscale Convolution and Deep Feature Combination Within a Transformer Framework.

Accurate Prediction Of Functional Effects For Variants By Combining Gradient Tree Boosting With Optimal Neighborhood Properties

SVPath: an accurate pipeline for predicting the pathogenicity of human exon structural variants

Embeddings from protein language models predict conservation and variant effects

Computational identification of deleterious synonymous variants in human genomes using a feature-based approach

Prediction of Disease-Associated Nssnps by Integrating Multi-Scale ResNet Models with Deep Feature Fusion.

VPatho: a deep learning-based two-stage approach for accurate prediction of gain-of-function and loss-of-function variants

PhyloTransformer: A Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

PhyloTransformer: A Self-supervised Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism