Abstract:Principal component analysis (PCA) has been widely used as an effective technique for feature extraction and dimension reduction. In the High Dimension Low Sample Size setting, one may prefer modified principal components, with penalized loadings, and automated penalty selection by implementing model selection among these different models with varying penalties. The earlier work (Zou et al. in J Comput Graph Stat 15(2):265–286, 2006; Gaynanova et al. in J Comput Graph Stat 26(2):379–387, 2017) has proposed penalized PCA, indicating the feasibility of model selection in \(\ell _2\)-penalized PCA through the solution path of Ridge regression, however, it is extremely time-consuming because of the intensive calculation of matrix inverse. In this paper, we propose a fast model selection method for penalized PCA, named approximated gradient flow (AgFlow), which lowers the computation complexity through incorporating the implicit regularization effect introduced by (stochastic) gradient flow (Ali et al. in: The 22nd international conference on artificial intelligence and statistics, pp 1370–1378, 2019; Ali et al. in: International conference on machine learning, 2020) and obtains the complete solution path of \(\ell _2\)-penalized PCA under varying \(\ell _2\)-regularization. We perform extensive experiments on real-world datasets. AgFlow outperforms existing methods (Oja and Karhunen in J Math Anal Appl 106(1):69–84, 1985; Hardt and Price in: Advances in neural information processing systems, pp 2861–2869, 2014; Shamir in: International conference on machine learning, pp 144–152, PMLR, 2015; and the vanilla Ridge estimators) in terms of computation costs.

Accelerated dimensionality reduction of single -cell RNA sequencing data with fastglmpca

GraphPCA: a fast and interpretable dimension reduction algorithm for spatial transcriptomics data

Probabilistic PCA of Censored Data: Accounting for Uncertainties in the Visualization of High-Throughput Single-Cell Qpcr Data.

Probabilistic Count Matrix Factorization for Single Cell Expression Data Analysis

PLPCA: Persistent Laplacian-Enhanced PCA for Microarray Data Analysis

Nonlinear dimensionality reduction based visualization of single-cell RNA sequencing data

Feature selection and dimension reduction for single-cell RNA-Seq based on a multinomial model

PLPCA: Persistent Laplacian Enhanced-PCA for Microarray Data Analysis

K-nearest-neighbors induced topological PCA for single cell RNA-sequence data analysis

Simultaneous Dimension Reduction And Adjustment For Confounding Variation

Adaptive gPCA: A method for structured dimensionality reduction

Fast and interpretable non-negative matrix factorization for atlas-scale single cell data

A fast, scalable and versatile tool for analysis of single-cell omics data

Model-based dimensionality reduction for single-cell RNA-seq using generalized bilinear models

Analytic Pearson residuals for normalization of single-cell RNA-seq UMI data

K-Nearest-Neighbors Induced Topological PCA for scRNA Sequence Data Analysis

AgFlow: fast model selection of penalized PCA via implicit regularization effects of gradient flow

A high-performance computing toolset for relatedness and principal component analysis of SNP data

Non-parametric modelling of temporal and spatial counts data from RNA-seq experiments

nPCA: a linear dimensionality reduction method using a multilayer perceptron

AE-TPGG: a novel autoencoder-based approach for single-cell RNA-seq data imputation and dimensionality reduction