Abstract:Gene expression involves transcription and translation. Despite large datasets and increasingly powerful methods devoted to calculating genetic variants’ effects on transcription, discrepancy between messenger RNA and protein levels hinders the systematic interpretation of the regulatory effects of disease-associated variants. Accurate models of the sequence determinants of translation are needed to close this gap and to interpret disease-associated variants that act on translation. Here we present Translatomer, a multimodal transformer framework that predicts cell-type-specific translation from messenger RNA expression and gene sequence. We train the Translatomer on 33 tissues and cell lines, and show that the inclusion of sequence improves the prediction of ribosome profiling signal, indicating that the Translatomer captures sequence-dependent translational regulatory information. The Translatomer achieves accuracies of 0.72 to 0.80 for the de novo prediction of cell-type-specific ribosome profiling. We develop an in silico mutagenesis tool to estimate mutational effects on translation and demonstrate that variants associated with translation regulation are evolutionarily constrained, both in the human population and across species. In particular, we identify cell-type-specific translational regulatory mechanisms independent of the expression quantitative trait loci for 3,041 non-coding and synonymous variants associated with complex diseases, including Alzheimer’s disease, schizophrenia and congenital heart disease. The Translatomer accurately models the genetic underpinnings of translation, bridging the gap between messenger RNA and protein levels as well as providing valuable mechanistic insights for uninterpreted disease variants. A transformer-based approach called Translatomer is presented, which models cell-type-specific translation from messenger RNA expression and gene sequence, bridging the gap between messenger RNA and protein levels as well as providing a mechanistic insight into the genetic regulation of translation.

A long context RNA foundation model for predicting transcriptome architecture

LncLSTA: A Versatile Predictor Unveiling Subcellular Localization of Lncrnas Through Long-Short Term Attention

Orthrus: Towards Evolutionary and Functional RNA Foundation Models

Interpretable RNA Foundation Model from Unannotated Data for Highly Accurate RNA Structure and Function Predictions

Deciphering RNA regulation with a foundation language model

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell Transcriptomics

Accurate RNA 3D Structure Prediction Using a Language Model-Based Deep Learning Approach

Deep Learning Prediction of Ribosome Profiling with Translatomer Reveals Translational Regulation and Interprets Disease Variants

Diverse Database and Machine Learning Model to Narrow the Generalization Gap in RNA Structure Prediction

HoRDA: Learning higher-order structure information for predicting RNA–disease associations

Single-sequence protein-RNA complex structure prediction by geometric attention-enabled pairing of biological language models

The Multiscale Ernwin/SPQR RNA Structure Prediction Pipeline

Deep annotation of long noncoding RNAs by assembling RNA-seq and small RNA-seq data

Multiple sequence alignment-based RNA language model and its application to structural inference

Rm-LR: A long-range-based deep learning model for predicting multiple types of RNA modifications

A technology-agnostic long-read analysis pipeline for transcriptome discovery and quantification

Multi-modal Transfer Learning between Biological Foundation Models

Secondary structure prediction of long noncoding RNA: review and experimental comparison of existing approaches

RiNALMo: General-Purpose RNA Language Models Can Generalize Well on Structure Prediction Tasks

Predicting Dynamic Cellular Protein–rna Interactions by Deep Learning Using in Vivo RNA Structures

Splicing Up Your Predictions with RNA Contrastive Learning