Abstract:Identifying causative variants is crucial for the diagnosis of rare genetic diseases. Over the past two decades, the application of genome sequencing technologies in the field has significantly improved diagnostic outcomes. However, the complexity of data analysis and interpretation continues to limit the efficiency and accuracy of these applications. Various genotype and phenotype-driven filtering and prioritization strategies are used to generate a candidate list of variants for expert curation, with the final report variants determined through knowledge-intensive and labor-intensive expert review. Despite these efforts, the current methods fall short of meeting the growing demand for accurate and efficient diagnosis of rare disease. Recent developments in large language models (LLMs) suggest that LLMs possess the potential to augment or even supplant human labor in this context. In this study, we have developed Genetic Transformer (GeneT), an innovative large language model (LLM) driven approach to accelerate identification of candidate causative variants for rare genetic disease. A comprehensive evaluation was conducted between the fine-tuned large language models and four phenotype-driven methods, including Xrare, Exomiser, PhenIX and PHIVE, alongside six pre-trained LLMs (Qwen1.5-0.5B, Qwen1.5-1.8B, Qwen1.5-4B, Mistral-7B, Meta-Llama-3-8B, Meta-Llama-3-70B). This evaluation focused on performance and hallucinations. Genetic Transformer (GeneT) as an innovative LLM-driven approach demonstrated outstanding performance on identification of candidate causative variants, identified the average number of candidate causative variants reduced from an average of 418 to 8, achieving recall rate of 99% in synthetic datasets. Application in real-world clinical setting demonstrated the potential for a 20-fold increase in processing speed, reducing the time required to analyze each sample from approximately 60 minutes to around 3 minutes. Concurrently, the recall rate has improved from 94.36% to 97.85%. An online analysis platform iGeneT was developed to integrate GeneT into the workflow of rare genetic disease analysis. Our study represents the inaugural application of fine-tuned LLMs for identifying candidate causative variants, introducing GeneT as an innovative LLM-driven approach, demonstrating its superiority in both simulated data and real-world clinical setting. The study is unique in that it represents a paradigm shift in addressing the complexity of variant filtering and prioritization of whole exome or genome sequencing data, effectively resolving the challenge akin to finding a needle in a haystack.

LOL-EVE: Predicting Promoter Variant Effects from Evolutionary Sequences

Deep Learning Prediction of Ribosome Profiling with Translatomer Reveals Translational Regulation and Interprets Disease Variants

Deep learning sequence-based ab initio prediction of variant effects on expression and disease risk

Genome-wide prediction of disease variant effects with a deep protein language model

Enhancing missense variant pathogenicity prediction with protein language models using VariPred

VariPred: Enhancing Pathogenicity Prediction of Missense Variants Using Protein Language Models

REVEL: an Ensemble Method for Predicting the Pathogenicity of Rare Missense Variants

Cross-protein transfer learning substantially improves disease variant prediction

The effect of genetic variation on promoter usage and enhancer activity

EMO: Predicting Non-coding Mutation-induced Up- and Down-regulation of Risk Gene Expression using Deep Learning

A semisupervised model to predict regulatory effects of genetic variants at single nucleotide resolution using massively parallel reporter assays

Deep learning approaches for non-coding genetic variant effect prediction: current progress and future prospects

Accurate prediction of functional effect of single amino acid variants with deep learning

Deep learning modeling of ribosome profiling reveals regulatory underpinnings of translatome and interprets disease variants

EXTRA-seq: a genome-integrated extended massively parallel reporter assay to quantify enhancer-promoter communication

In silico generation and augmentation of regulatory variants from massively parallel reporter assay using conditional variational autoencoder

TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding Fusion

Genetic Transformer: An Innovative Large Language Model Driven Approach for Rapid and Accurate Identification of Causative Variants in Rare Genetic Diseases

Evolution is All You Need in Promoter Design and Optimization

Assessment of variant effect predictors unveils variants difficulty as a critical performance indicator

Leveraging Multiple Genomic Data to Prioritize Disease-Causing Indels from Exome Sequencing Data