Abstract:The current high-dimensional linear factor models fail to account for the different types of variables, while high-dimensional nonlinear factor models often overlook the overdispersion present in mixed-type data. However, overdispersion is prevalent in practical applications, particularly in fields like biomedical and genomics studies. To address this practical demand, we propose an overdispersed generalized factor model (OverGFM) for performing high-dimensional nonlinear factor analysis on overdispersed mixed-type data. Our approach incorporates an additional error term to capture the overdispersion that cannot be accounted for by factors alone. However, this introduces significant computational challenges due to the involvement of two high-dimensional latent random matrices in the nonlinear model. To overcome these challenges, we propose a novel variational EM algorithm that integrates Laplace and Taylor approximations. This algorithm provides iterative explicit solutions for the complex variational parameters and is proven to possess excellent convergence properties. We also develop a criterion based on the singular value ratio to determine the optimal number of factors. Numerical results demonstrate the effectiveness of this criterion. Through comprehensive simulation studies, we show that OverGFM outperforms state-of-the-art methods in terms of estimation accuracy and computational efficiency. Furthermore, we demonstrate the practical merit of our method through its application to two datasets from genomics. To facilitate its usage, we have integrated the implementation of OverGFM into the R package GFM.

Separating biological variance from noise by applying EM algorithm to modified General Linear Model

An Improved Algorithm for High-Dimensional Continuous Threshold Expectile Model with Variance Heterogeneity

Linear mixed effects models for non‐Gaussian continuous repeated measurement data

Regularized EM Algorithms: A Unified Framework and Statistical Guarantees

Using Em to Obtain Asymptotic Variance - Covariance Matrices - the Sem Algorithm

Regularized EM algorithm

MM Algorithms for Variance Components Models

Exploring an EM-algorithm for banded regression in computational neuroscience

Stochastic Expectation Maximization with Variance Reduction.

Regularized EM algorithm for sparse parameter estimation in nonlinear dynamic systems with application to gene regulatory network inference

Use and abuse of variance models in regression

Variance component model to account for sample structure in genome-wide association studies

Model Variance for Extreme Learning Machine

Expectation-maximization for logistic regression

On GEE for Mean-Variance-Correlation Models: Variance Estimation and Model Selection

On the global and componentwise rates of convergence of the EM algorithm

The use of the EM algorithm for regularization problems in high-dimensional linear mixed-effects models

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Exponential family measurement error models for single-cell CRISPR screens

High-Dimensional Overdispersed Generalized Factor Model With Application to Single-Cell Sequencing Data Analysis

Variable selection method for the identification of epistatic models.