Abstract:One of the challenges in a viral pandemic is the emergence of novel variants with different phenotypical characteristics. An ability to forecast future viral individuals at the sequence level enables advance preparation by characterizing the sequences and closing vulnerabilities in current preventative and therapeutic methods. In this article, we explore, in the context of a viral pandemic, the problem of generating complete instances of undiscovered viral protein sequences, which have a high likelihood of being discovered in the future using protein language models. Current approaches to training these models fit model parameters to a known sequence set, which does not suit pandemic forecasting as future sequences differ from known sequences in some respects. To address this, we develop a novel method, called PandoGen, to train protein language models towards the pandemic protein forecasting task. PandoGen combines techniques such as synthetic data generation, conditional sequence generation, and reward-based learning, enabling the model to forecast future sequences, with a high propensity to spread. Applying our method to modeling the SARS-CoV-2 Spike protein sequence, we find empirically that our model forecasts twice as many novel sequences with five times the case counts compared to a model that is 30× larger. Our method forecasts unseen lineages months in advance, whereas models 4× and 30× larger forecast almost no new lineages. When trained on data available up to a month before the onset of important Variants of Concern, our method consistently forecasts sequences belonging to those variants within tight sequence budgets. Viral protein sequences play a pivotal role in the spread of a pandemic. As the virus evolves, so do the viral proteins, increasing the potency of the virus. Knowledge of future viral protein sequences can be invaluable because it allows us to test the efficacy of preventative and treatment methods against future changes to the virus, and tailor them to such changes early. We attempt to forecast viral proteins ahead of time. Making such predictions is very challenging and complex because the prediction target is a sequence with thousands of positions, and a single mis-predicted sequence position may invalidate the entire prediction. Also, as the virus continues to evolve, the data available to train models becomes obsolete. Addressing these challenges, we create a novel approach to train models of the SARS-CoV-2 Spike protein, that are especially tailored to forecasting future sequences. Models trained using this approach outperform existing approaches in their effectiveness. In addition, our method can train models to forecast important pandemic variants ahead of time.

Generative AI in the Advancement of Viral Therapeutics for Predicting and Targeting Immune-Evasive SARS-CoV-2 Mutations

Variation and Evolution Analysis of SARS-CoV-2 Using Self-Game Sequence Optimization

Predicting the Epidemics Trend of COVID-19 Using Epidemiological-Based Generative Adversarial Networks.

Predicting the immune escape of SARS-CoV-2 neutralizing antibodies upon mutation

Modeling the trajectory of SARS-CoV-2 spike protein evolution in continuous latent space using a neural network and Gaussian process

Protein design for evaluating vaccines against future viral variation

PandoGen: Generating complete instances of future SARS-CoV-2 sequences using Deep Learning

Comprehensive Analysis of SARS-CoV-2 Spike Evolution: Epitope Classification and Immune Escape Prediction

Topological AI forecasting of future dominating viral variants

Generation of SARS‐CoV‐2 spike receptor binding domain mutants and functional screening for immune evaders using a novel lentivirus‐based system

Prediction of Prospective Mutational Landscape of SARS-CoV-2 Spike ssRNA and Evolutionary Basis of Its Host Interaction

A prediction of mutations in infectious viruses using artificial intelligence

Predicting Natural Evolution in the RBD Region of the Spike Glycoprotein of SARS-CoV-2 by Machine Learning

Predicting the antigenic evolution of SARS-COV-2 with deep learning

VirEvol platform : accurate prediction and visualization of SARS-CoV-2 evolutionary trajectory based on protein language model, structural information and immunological recognition mechanism

Deep-learning-enabled generative prevalent mutation prediction through host-to-herd in silico virus evolution

Spike deep mutational scanning helps predict success of SARS-CoV-2 clades

Predicting Spike Protein NTD Mutations of SARS-CoV-2 Causing Immune Escape by Molecular Dynamics Simulations

An in silico deep learning approach to multi-epitope vaccine design: a SARS-CoV-2 case study

Epistatic models predict mutable sites in SARS-CoV-2 proteins and epitopes

Anti-virus Autobots: Predicting More Infectious Virus Variants for Pandemic Prevention through Deep Learning