Genomic language model predicts protein co-regulation and function

Yunha Hwang,Andre L. Cornman,Elizabeth H. Kellogg,Sergey Ovchinnikov,Peter R. Girguis

DOI: https://doi.org/10.1038/s41467-024-46947-9

IF: 16.6

2024-04-03

Nature Communications

Abstract:Abstract Deciphering the relationship between a gene and its genomic context is fundamental to understanding and engineering biological systems. Machine learning has shown promise in learning latent relationships underlying the sequence-structure-function paradigm from massive protein sequence datasets. However, to date, limited attempts have been made in extending this continuum to include higher order genomic context information. Evolutionary processes dictate the specificity of genomic contexts in which a gene is found across phylogenetic distances, and these emergent genomic patterns can be leveraged to uncover functional relationships between gene products. Here, we train a genomic language model (gLM) on millions of metagenomic scaffolds to learn the latent functional and regulatory relationships between genes. gLM learns contextualized protein embeddings that capture the genomic context as well as the protein sequence itself, and encode biologically meaningful and functionally relevant information (e.g. enzymatic function, taxonomy). Our analysis of the attention patterns demonstrates that gLM is learning co-regulated functional modules (i.e. operons). Our findings illustrate that gLM’s unsupervised deep learning of the metagenomic corpus is an effective and promising approach to encode functional semantics and regulatory syntax of genes in their genomic contexts and uncover complex relationships between genes in a genomic region.

multidisciplinary sciences

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address the relationship between genes and their genomic environment to better understand and design biological systems. Specifically:

1. **Gene Function Prediction**: By training a genomic language model (gLM), it learns the functions and regulatory relationships of genes from a large number of metagenomic sequences.
2. **Context Dependency**: It studies the functional changes of genes in different genomic environments, revealing the complex relationship between genes and their genomic background.
3. **Evolutionary Process**: It explores how evolutionary processes determine the distribution and function of genes in different organisms.
4. **Co-regulation Module Identification**: By analyzing the attention patterns of the model, it identifies co-regulated functional modules (such as operons).

Overall, this paper utilizes deep learning methods, particularly language models based on the transformer architecture, to explore the functions and regulatory mechanisms of genes in different genomic contexts, thereby better understanding the interactions between genes and their environment.