Integrating Prior Knowledge Using Transformer for Gene Regulatory Network Inference

Guangzheng Weng,Patrick Martin,Hyobin Kim,Kyoung Jae Won
DOI: https://doi.org/10.1002/advs.202409990
IF: 15.1
2024-11-30
Advanced Science
Abstract:GRNPT is a powerful tool for reconstructing gene regulatory networks (GRNs) from single‐cell data. By combining gene embeddings from large language models with temporal information, GRNPT accurately identifies regulatory relationships between genes. Its ability to generalize to unseen data makes it highly adaptable. Even with limited prior knowledge of gene regulations, GRNPT can effectively reconstruct large and reliable GRNs. Gene regulatory network (GRN) inference, a process of reconstructing gene regulatory rules from experimental data, has the potential to discover new regulatory rules. However, existing methods often struggle to generalize across diverse cell types and account for unseen regulators. Here, this work presents GRNPT, a novel Transformer‐based framework that integrates large language model (LLM) embeddings from publicly accessible biological data and a temporal convolutional network (TCN) autoencoder to capture regulatory patterns from single‐cell RNA sequencing (scRNA‐seq) trajectories. GRNPT significantly outperforms both supervised and unsupervised methods in inferring GRNs, particularly when training data is limited. Notably, GRNPT exhibits exceptional generalizability, accurately predicting regulatory relationships in previously unseen cell types and even regulators. By combining LLMs ability to distillate biological knowledge from text and deep learning methodologies capturing complex patterns in gene expression data, GRNPT overcomes the limitations of traditional GRN inference methods and enables more accurate and comprehensive understanding of gene regulatory dynamics.
materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
What problem does this paper attempt to address?