Abstract:Deep learning techniques are increasingly utilized to analyze large-scale single-cell RNA sequencing (scRNA-seq) data, offering valuable insights from complex transcriptome datasets. Geneformer, a pre-trained model using a Transformer Encoder architecture and human scRNA-seq datasets, has demonstrated remarkable success in human transcriptome analysis. However, given the prominence of the mouse, , as a primary mammalian model in biological and medical research, there is an acute need for a mouse-specific version of Geneformer. In this study, we developed a mouse-specific Geneformer (mouse-Geneformer) by constructing a large transcriptome dataset consisting of 21 million mouse scRNA-seq profiles and pre-training Geneformer on this dataset. The mouse-Geneformer effectively models the mouse transcriptome and, upon fine-tuning for downstream tasks, enhances the accuracy of cell type classification. In silico perturbation experiments using mouse-Geneformer successfully identified disease-causing genes that have been validated in in vivo experiments. These results demonstrate the feasibility of analyzing mouse data with mouse-Geneformer and highlight the robustness of the Geneformer architecture, applicable to any species with large-scale transcriptome data available. Furthermore, we found that mouse-Geneformer can analyze human transcriptome data in a cross-species manner. After the ortholog-based gene name conversion, the analysis of human scRNA-seq data using mouse-Geneformer, followed by fine-tuning with human data, achieved cell type classification accuracy comparable to that obtained using the original human Geneformer. In in silico simulation experiments using human disease models, we obtained results similar to human-Geneformer for the myocardial infarction model but only partially consistent results for the COVID-19 model, a trait unique to humans (laboratory mice are not susceptible to SARS-CoV-2). These findings suggest the potential for cross-species application of the Geneformer model while emphasizing the importance of species-specific models for capturing the full complexity of disease mechanisms. Despite the existence of the original Geneformer tailored for humans, human research could benefit from mouse-Geneformer due to its inclusion of samples that are ethically or technically inaccessible for humans, such as embryonic tissues and certain disease models. Additionally, this cross-species approach indicates potential use for non-model organisms, where obtaining large-scale single-cell transcriptome data is challenging.

Interpretation of murine models of cardiac disease is enhanced by consideration of divergently expressed human-mouse orthologous genes

Transfer Learning Efficiently Maps Bone Marrow Cell Types from Mouse to Human Using Single-Cell RNA Sequencing

Improved integration of single-cell transcriptome data demonstrates common and unique signatures of heart failure in mice and humans

Concordant and Heterogeneity of Single-Cell Transcriptome in Cardiac Development of Human and Mouse

Genes in Humans and Mice: Insights from Deep learning of 777K Bulk Transcriptomes

Developmental anatomy of the heart: a tale of mice and man

Small Mammalian Animal Models of Heart Disease.

Defining the Functional Divergence of Orthologous Genes Between Human and Mouse in the Context of Mirna Regulation

Integrated transcriptomics and epigenomics reveal chamber-specific and species-specific characteristics of human and mouse hearts

Abstract P1185: Spatial Transcriptome Profiling In The Mouse Heart With Single-Cell Resolution

Deciphering Cell-Type-Specific Gene Expression Signatures of Cardiac Diseases Through Reconstruction of Bulk Transcriptomes

Sexually dimorphic gene expression in the heart of mice and men

The Differences in the Developmental Stages of the Cardiomyocytes and Endothelial Cells in Human and Mouse Embryos at the Single-Cell Level

Knockout mice are an important tool for human monogenic heart disease studies

Comparison of cardiac excitation-contraction coupling in isolated ventricular myocytes between rat and mouse.

Characterization And Comparison Of The Tissue-Related Modules In Human And Mouse

Mouse-Geneformer: A Deep Learning Model for Mouse Single-Cell Transcriptome and Its Cross-Species Utility

Abstract MP203: Decoding the Cardiac Regulatory Long Noncoding RNAs in Male and Female Mice Using Integrative Multiomics Analysis

Single-cell RNA Sequencing of Mouse Left Ventricle Reveals Cellular Diversity and Intercommunication.

Gene expression analysis to identify mechanisms underlying heart failure susceptibility in mice and humans

Novel Insights into Post-Myocardial Infarction Cardiac Remodeling through Algorithmic Detection of Cell-Type Composition Shifts