Abstract:Deep learning techniques are increasingly utilized to analyze large-scale single-cell RNA sequencing (scRNA-seq) data, offering valuable insights from complex transcriptome datasets. Geneformer, a pre-trained model using a Transformer Encoder architecture and human scRNA-seq datasets, has demonstrated remarkable success in human transcriptome analysis. However, given the prominence of the mouse, , as a primary mammalian model in biological and medical research, there is an acute need for a mouse-specific version of Geneformer. In this study, we developed a mouse-specific Geneformer (mouse-Geneformer) by constructing a large transcriptome dataset consisting of 21 million mouse scRNA-seq profiles and pre-training Geneformer on this dataset. The mouse-Geneformer effectively models the mouse transcriptome and, upon fine-tuning for downstream tasks, enhances the accuracy of cell type classification. In silico perturbation experiments using mouse-Geneformer successfully identified disease-causing genes that have been validated in in vivo experiments. These results demonstrate the feasibility of analyzing mouse data with mouse-Geneformer and highlight the robustness of the Geneformer architecture, applicable to any species with large-scale transcriptome data available. Furthermore, we found that mouse-Geneformer can analyze human transcriptome data in a cross-species manner. After the ortholog-based gene name conversion, the analysis of human scRNA-seq data using mouse-Geneformer, followed by fine-tuning with human data, achieved cell type classification accuracy comparable to that obtained using the original human Geneformer. In in silico simulation experiments using human disease models, we obtained results similar to human-Geneformer for the myocardial infarction model but only partially consistent results for the COVID-19 model, a trait unique to humans (laboratory mice are not susceptible to SARS-CoV-2). These findings suggest the potential for cross-species application of the Geneformer model while emphasizing the importance of species-specific models for capturing the full complexity of disease mechanisms. Despite the existence of the original Geneformer tailored for humans, human research could benefit from mouse-Geneformer due to its inclusion of samples that are ethically or technically inaccessible for humans, such as embryonic tissues and certain disease models. Additionally, this cross-species approach indicates potential use for non-model organisms, where obtaining large-scale single-cell transcriptome data is challenging.

Mouse embryo CoCoPUTs: novel murine transcriptomic-weighted usage website featuring multiple strains, tissues, and stages

Towards Functional Annotation of the Preimplantation Transcriptome: an RNAi Screen in Mammalian Embryos.

The changing mouse embryo transcriptome at whole tissue and single-cell resolution

A comparative genome analysis of gene expression reveals different regulatory mechanisms between mouse and human embryo pre-implantation development

Mouse IDGenes: a Reference Database for Genetic Interactions in the Developing Mouse Brain.

Genetic Programs in Human and Mouse Early Embryos Revealed by Single-Cell RNA Sequencing

Developmental stage related patterns of codon usage and genomic GC content: searching for evolutionary fingerprints with models of stem cell differentiation

Mouse-Geneformer: A Deep Learning Model for Mouse Single-Cell Transcriptome and Its Cross-Species Utility

Devmouse, The Mouse Developmental Methylome Database And Analysis Tools

Three-dimension transcriptomics maps of whole mouse embryo during organogenesis

Global Expression Profiling Reveals Genetic Programs Underlying the Developmental Divergence Between Mouse and Human Embryogenesis

Genes in Humans and Mice: Insights from Deep learning of 777K Bulk Transcriptomes

Mouse Genome Database (MGD): Knowledgebase for mouse–human comparative biology

Spatiotemporal DNA methylome dynamics of the developing mouse fetus

GenomeMUSter mouse genetic variation service enables multitrait, multipopulation data integration and analysis

The Mouse Genome Database (MGD): comprehensive resource for genetics and genomics of the laboratory mouse

Dbembryo Multi-Omics Database for Analyses of Synergistic Regulation in Early Mammalian Embryo Development

Global Detection and Identification of Developmental Stage Specific Transcripts in Mouse Brain Using Subtractive Cross-Screening Algorithm

A Map of the Cis-Regulatory Sequences in the Mouse Genome

DevOmics: an integrated multi-omics database of human and mouse early embryo

A Comprehensive Mouse Transcriptomic BodyMap across 17 Tissues by RNA-seq