Genetic Transformer: An Innovative Large Language Model Driven Approach for Rapid and Accurate Identification of Causative Variants in Rare Genetic Diseases

Lungang Liang,Yulan Chen,Taifu Wang,Dan Jiang,Jishuo Jin,Yanmeng Pang,Qin Na,Qiang Liu,Xiaosen Jiang,Wentao Dai,Meifang Tang,Yutao Du,Dirong Peng,Xin Jin,Lijian Zhao
DOI: https://doi.org/10.1101/2024.07.18.24310666
2024-07-19
Abstract:Identifying causative variants is crucial for the diagnosis of rare genetic diseases. Over the past two decades, the application of genome sequencing technologies in the field has significantly improved diagnostic outcomes. However, the complexity of data analysis and interpretation continues to limit the efficiency and accuracy of these applications. Various genotype and phenotype-driven filtering and prioritization strategies are used to generate a candidate list of variants for expert curation, with the final report variants determined through knowledge-intensive and labor-intensive expert review. Despite these efforts, the current methods fall short of meeting the growing demand for accurate and efficient diagnosis of rare disease. Recent developments in large language models (LLMs) suggest that LLMs possess the potential to augment or even supplant human labor in this context. In this study, we have developed Genetic Transformer (GeneT), an innovative large language model (LLM) driven approach to accelerate identification of candidate causative variants for rare genetic disease. A comprehensive evaluation was conducted between the fine-tuned large language models and four phenotype-driven methods, including Xrare, Exomiser, PhenIX and PHIVE, alongside six pre-trained LLMs (Qwen1.5-0.5B, Qwen1.5-1.8B, Qwen1.5-4B, Mistral-7B, Meta-Llama-3-8B, Meta-Llama-3-70B). This evaluation focused on performance and hallucinations. Genetic Transformer (GeneT) as an innovative LLM-driven approach demonstrated outstanding performance on identification of candidate causative variants, identified the average number of candidate causative variants reduced from an average of 418 to 8, achieving recall rate of 99% in synthetic datasets. Application in real-world clinical setting demonstrated the potential for a 20-fold increase in processing speed, reducing the time required to analyze each sample from approximately 60 minutes to around 3 minutes. Concurrently, the recall rate has improved from 94.36% to 97.85%. An online analysis platform iGeneT was developed to integrate GeneT into the workflow of rare genetic disease analysis. Our study represents the inaugural application of fine-tuned LLMs for identifying candidate causative variants, introducing GeneT as an innovative LLM-driven approach, demonstrating its superiority in both simulated data and real-world clinical setting. The study is unique in that it represents a paradigm shift in addressing the complexity of variant filtering and prioritization of whole exome or genome sequencing data, effectively resolving the challenge akin to finding a needle in a haystack.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to rapidly and accurately identify pathogenic variants in rare genetic diseases. Specifically, the authors point out that although the application of genomic sequencing technologies in the past two decades has significantly improved diagnostic results, the complexity of data analysis and interpretation still limits the efficiency and accuracy of these technologies. Current methods generate a list of candidate variants through genotype - and phenotype - driven filtering and prioritization strategies and determine the finally reported variants through expert review, but still cannot meet the growing demands in terms of accuracy and efficiency. Therefore, this study aims to develop a new method based on large - language models (LLMs) - Genetic Transformer (GeneT) - to accelerate the identification process of candidate pathogenic variants in rare genetic diseases. The main objectives of the paper are: 1. **Improve efficiency**: Reduce the time required to screen out pathogenic variants from a large number of variants. 2. **Improve accuracy**: While reducing the number of candidate variants, maintain or improve the recall rate (i.e., the proportion of correctly identified pathogenic variants). 3. **Reduce manual labor**: Leverage the potential of LLMs to reduce the reliance on manual expert review. To achieve these goals, the research team carried out the following work: - Developed the GeneT model and conducted a systematic evaluation of it. - Compared the performance of GeneT with existing phenotype - driven variant prioritization methods in synthetic datasets and real - clinical settings. - Developed an online analysis platform, iGeneT, so that users can perform variant analysis through a web interface. The research results show that in the synthetic dataset, GeneT reduces the average number of candidate pathogenic variants from 418 to 8, with a recall rate of 99%. In the real - clinical environment, GeneT can reduce the analysis time per sample from approximately 60 minutes to approximately 3 minutes, while the recall rate increases from 94.36% to 97.40%. These results indicate that GeneT has significant advantages in improving the efficiency and accuracy of rare genetic disease diagnosis.