Abstract:Deep learning techniques are increasingly utilized to analyze large-scale single-cell RNA sequencing (scRNA-seq) data, offering valuable insights from complex transcriptome datasets. Geneformer, a pre-trained model using a Transformer Encoder architecture and human scRNA-seq datasets, has demonstrated remarkable success in human transcriptome analysis. However, given the prominence of the mouse, , as a primary mammalian model in biological and medical research, there is an acute need for a mouse-specific version of Geneformer. In this study, we developed a mouse-specific Geneformer (mouse-Geneformer) by constructing a large transcriptome dataset consisting of 21 million mouse scRNA-seq profiles and pre-training Geneformer on this dataset. The mouse-Geneformer effectively models the mouse transcriptome and, upon fine-tuning for downstream tasks, enhances the accuracy of cell type classification. In silico perturbation experiments using mouse-Geneformer successfully identified disease-causing genes that have been validated in in vivo experiments. These results demonstrate the feasibility of analyzing mouse data with mouse-Geneformer and highlight the robustness of the Geneformer architecture, applicable to any species with large-scale transcriptome data available. Furthermore, we found that mouse-Geneformer can analyze human transcriptome data in a cross-species manner. After the ortholog-based gene name conversion, the analysis of human scRNA-seq data using mouse-Geneformer, followed by fine-tuning with human data, achieved cell type classification accuracy comparable to that obtained using the original human Geneformer. In in silico simulation experiments using human disease models, we obtained results similar to human-Geneformer for the myocardial infarction model but only partially consistent results for the COVID-19 model, a trait unique to humans (laboratory mice are not susceptible to SARS-CoV-2). These findings suggest the potential for cross-species application of the Geneformer model while emphasizing the importance of species-specific models for capturing the full complexity of disease mechanisms. Despite the existence of the original Geneformer tailored for humans, human research could benefit from mouse-Geneformer due to its inclusion of samples that are ethically or technically inaccessible for humans, such as embryonic tissues and certain disease models. Additionally, this cross-species approach indicates potential use for non-model organisms, where obtaining large-scale single-cell transcriptome data is challenging.

Genome rewriting generates mouse models of human diseases

Mouse genome rewriting and tailoring of three important disease loci

[Applications of ZFN, TALEN and CRISPR/Cas9 Techniques in Disease Modeling and Gene Therapy].

Genetically modified mice as a tool for the study of human diseases

Mouse genomic rewriting and tailoring: synthetic Trp53 and humanized ACE2

Application of genome editing technologies in rats for human disease models

Efficient and Fast Generation of Relevant Disease Mouse Models by In Vitro and In Vivo Gene Editing of Zygotes

A Recql5 mutant facilitates complex CRISPR/Cas9-mediated-chromosomal engineering in mouse zygotes

Genome editing methods in animal models

Mouse Systems Genetics as a Prelude to Precision Medicine

Gene replacement‐Alzheimer's disease (GR‐AD): Modeling the genetics of human dementias in mice

Disease research and drug development models based on genetically altered human embryonic stem cells.

New routes for transgenesis of the mouse

CRISPR/Cas9: a powerful genetic engineering tool for establishing large animal models of neurodegenerative diseases

Engineering large animal models of human disease

Mouse-Geneformer: A Deep Learning Model for Mouse Single-Cell Transcriptome and Its Cross-Species Utility

A prime editor mouse to model a broad spectrum of somatic mutations in vivo

Large-scale Screening of Disease Model Through ENU Mutagenesis in Mice

Genetic Modification of Mice Using Prime Editing

Gene Editing in Rat Embryonic Stem Cells to Produce In Vitro Models and In Vivo Reporters

Human ACE2 Gene Replacement Mice Support SARS-CoV-2 Viral Replication and Nonlethal Disease Progression