Abstract:Gene expression involves transcription and translation. Despite large datasets and increasingly powerful methods devoted to calculating genetic variants’ effects on transcription, discrepancy between messenger RNA and protein levels hinders the systematic interpretation of the regulatory effects of disease-associated variants. Accurate models of the sequence determinants of translation are needed to close this gap and to interpret disease-associated variants that act on translation. Here we present Translatomer, a multimodal transformer framework that predicts cell-type-specific translation from messenger RNA expression and gene sequence. We train the Translatomer on 33 tissues and cell lines, and show that the inclusion of sequence improves the prediction of ribosome profiling signal, indicating that the Translatomer captures sequence-dependent translational regulatory information. The Translatomer achieves accuracies of 0.72 to 0.80 for the de novo prediction of cell-type-specific ribosome profiling. We develop an in silico mutagenesis tool to estimate mutational effects on translation and demonstrate that variants associated with translation regulation are evolutionarily constrained, both in the human population and across species. In particular, we identify cell-type-specific translational regulatory mechanisms independent of the expression quantitative trait loci for 3,041 non-coding and synonymous variants associated with complex diseases, including Alzheimer’s disease, schizophrenia and congenital heart disease. The Translatomer accurately models the genetic underpinnings of translation, bridging the gap between messenger RNA and protein levels as well as providing valuable mechanistic insights for uninterpreted disease variants. A transformer-based approach called Translatomer is presented, which models cell-type-specific translation from messenger RNA expression and gene sequence, bridging the gap between messenger RNA and protein levels as well as providing a mechanistic insight into the genetic regulation of translation.

PhyloTransformer: A Self-supervised Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

PhyloTransformer: A Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

TEMPO: A Transformer-Based Mutation Prediction Framework for SARS-CoV-2 Evolution

Variation and Evolution Analysis of SARS-CoV-2 Using Self-Game Sequence Optimization

Evolution-guided Large Language Model is a Predictor of Virus Mutation Trends

A prediction of mutations in infectious viruses using artificial intelligence

Deciphering the Language of Nature: A transformer-based language model for deleterious mutations in proteins

Predicting the immune escape of SARS-CoV-2 neutralizing antibodies upon mutation

Self-attention based deep learning model for predicting the coronavirus sequences from high-throughput sequencing data

Identifying COVID-19 Severity-Related SARS-CoV-2 Mutation Using a Machine Learning Method

TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding Fusion

Tempel: time-series mutation prediction of influenza A viruses via attention-based recurrent neural networks

Deep Learning Prediction of Ribosome Profiling with Translatomer Reveals Translational Regulation and Interprets Disease Variants

TDFFM: Transformer and Deep Forest Fusion Model for Predicting Coronavirus 3C-Like Protease Cleavage Sites

TfrAdmCov: a robust transformer encoder based model with Adam optimizer algorithm for COVID-19 mutation prediction

Machine Learning in Bioinformatics: COVID-19 Mutation Prediction

Running Ahead of Evolution - AI Based Simulation for Predicting Future High-Risk SARS-CoV-2 Variants

ACVPred: Enhanced prediction of anti-coronavirus peptides by transfer learning combined with data augmentation

Prediction of mutation effects using a deep temporal convolutional network

Classification of Highly Divergent Viruses from DNA/RNA Sequence Using Transformer-Based Models

Co-Mutations and Possible Variation Tendency of the Spike RBD and Membrane Protein in SARS-CoV-2 by Machine Learning