Abstract:Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused an ongoing pandemic infecting 219 million people as of 10/19/21, with a 3.6% mortality rate. Natural selection can generate favorable mutations with improved fitness advantages; however, the identified coronaviruses may be the tip of the iceberg, and potentially more fatal variants of concern (VOCs) may emerge over time. Understanding the patterns of emerging VOCs and forecasting mutations that may lead to gain of function or immune escape is urgently required. Here we developed PhyloTransformer, a Transformer-based discriminative model that engages a multi-head self-attention mechanism to model genetic mutations that may lead to viral reproductive advantage. In order to identify complex dependencies between the elements of each input sequence, PhyloTransformer utilizes advanced modeling techniques, including a novel Fast Attention Via positive Orthogonal Random features approach (FAVOR+) from Performer, and the Masked Language Model (MLM) from Bidirectional Encoder Representations from Transformers (BERT). PhyloTransformer was trained with 1,765,297 genetic sequences retrieved from the Global Initiative for Sharing All Influenza Data (GISAID) database. Firstly, we compared the prediction accuracy of novel mutations and novel combinations using extensive baseline models; we found that PhyloTransformer outperformed every baseline method with statistical significance. Secondly, we examined predictions of mutations in each nucleotide of the receptor binding motif (RBM), and we found our predictions were precise and accurate. Thirdly, we predicted modifications of N-glycosylation sites to identify mutations associated with altered glycosylation that may be favored during viral evolution. We anticipate that PhyloTransformer may guide proactive vaccine design for effective targeting of future SARS-CoV-2 variants.

Machine Learning in Bioinformatics: COVID-19 Mutation Prediction

Predicting the immune escape of SARS-CoV-2 neutralizing antibodies upon mutation

Variation and Evolution Analysis of SARS-CoV-2 Using Self-Game Sequence Optimization

Identifying COVID-19 Severity-Related SARS-CoV-2 Mutation Using a Machine Learning Method

Detection of COVID-19 Using Protein Sequence Data via Machine Learning Classification Approach

Predicting Natural Evolution in the RBD Region of the Spike Glycoprotein of SARS-CoV-2 by Machine Learning

A prediction of mutations in infectious viruses using artificial intelligence

Potential neutralizing antibodies discovered for novel corona virus using machine learning

Variant-driven multi-wave pattern of COVID-19 via a Machine Learning analysis of spike protein mutations

TEMPO: A Transformer-Based Mutation Prediction Framework for SARS-CoV-2 Evolution

Co-Mutations and Possible Variation Tendency of the Spike RBD and Membrane Protein in SARS-CoV-2 by Machine Learning

A Machine Learning Approach to Identify Key Residues Involved in Protein–Protein Interactions Exemplified with SARS-CoV-2 Variants

Evolution-guided Large Language Model is a Predictor of Virus Mutation Trends

Prediction of Prospective Mutational Landscape of SARS-CoV-2 Spike ssRNA and Evolutionary Basis of Its Host Interaction

PhyloTransformer: A Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

Mutation prediction in the SARS-CoV-2 genome using attention-based neural machine translation

Mathematical artificial intelligence design of mutation-proof COVID-19 monoclonal antibodies

Staying Ahead of the Game: How SARS-CoV-2 has Accelerated the Application of Machine Learning in Pandemic Management

Machine Learning Driven Simulations of SARS-CoV-2 Fitness Landscape

Benchmarking machine learning robustness in Covid-19 genome sequence classification

Fighting Mutations with Mutations: Evolutionarily Adapting a DNA Aptamer for High-Affinity Recognition of Mutated Spike Proteins of SARS-CoV-2