What is principal component analysis?

Markus Ringnér

DOI: https://doi.org/10.1038/nbt0308-303

IF: 46.9

2008-03-01

Nature Biotechnology

Abstract:Principal component analysis is often incorporated into genome-wide expression studies, but what is it and how can it be used to explore high-dimensional data?

biotechnology & applied microbiology

What problem does this paper attempt to address?

Principal Component Analyses in Anthropological Genetics

Xingdong Chen,Chao Chen,Li Jin

DOI: https://doi.org/10.4236/aa.2011.12002

2011-01-01

Advances in Anthropology

Abstract:Principal component analyses (PCA) is a statistical method for exploring and making sense of datasets with a large number of measurements (which can be thought of as dimensions) by reducing the dimensions to the few principal components (PCs) that explain the main patterns. Thus, the first PC is the mathematical combination of measurements that accounts for the largest amount of variability in the data. Here, we gave an interpretation about the principle of PCA and its original mathematical algorithm, singular variable decomposition (SVD). PCA can be used in study of gene expression; also PCA has a population genetics interpretation and can be used to identify differences in ancestry among populations and samples, through there are some limitations due to the dynamics of microevolution and historical processes, with advent of molecular techniques, PCA on Y chromosome, mtDNA, and nuclear DNA gave us more accurate interpretations than on classical markers. Furthermore, we list some new extensions and limits of PCA.
[Principal Component Analysis for Exploring Gene Expression Patterns].

Chengxiong Wang,Nini Rao,Yu Wang

DOI: https://doi.org/10.3321/j.issn:1001-5515.2007.04.005

2007-01-01

Abstract:When projecting microarray data of yeast time series into principal component space based on time-points (arrays), we can not only ascribe biologically meaningful explanations to the first few principal components, but also discover sensible gene expression patterns and the according genes with periodic fluctuation this helps the subsequent research of gene periodic expression and gene regulatory network.
Power Analysis of Principal Components Regression in Genetic Association Studies.

Yan-feng Shen,Jun Zhu

DOI: https://doi.org/10.1631/jzus.b0830866

2009-01-01

Journal of Zhejiang University SCIENCE B

Abstract:Association analysis provides an opportunity to find genetic variants underlying complex traits. A principal components regression (PCR)-based approach was shown to outperform some competing approaches. However, a limitation of this method is that the principal components (PCs) selected from single nucleotide polymorphisms (SNPs) may be unrelated to the phenotype. In this article, we investigate the theoretical properties of such a method in more detail. We first derive the exact power function of the test based on PCR, and hence clarify the relationship between the test power and the degrees of freedom (DF). Next, we extend the PCR test to a general weighted PCs test, which provides a unified framework for understanding the properties of some related statistics. We then compare the performance of these tests. We also introduce several data-driven adaptive alternatives to overcome difficulties in the PCR approach. Finally, we illustrate our results using simulations based on real genotype data. Simulation study shows the risk of using the unsupervised rule to determine the number of PCs, and demonstrates that there is no single uniformly powerful method for detecting genetic variants.
Principal component analysis: a review and recent developments

Ian T. Jolliffe,Jorge Cadima

DOI: https://doi.org/10.1098/rsta.2015.0202

2016-04-13

Abstract:Large datasets are increasingly common and are often difficult to interpret. Principal component analysis (PCA) is a technique for reducing the dimensionality of such datasets, increasing interpretability but at the same time minimizing information loss. It does so by creating new uncorrelated variables that successively maximize variance. Finding such new variables, the principal components, reduces to solving an eigenvalue/eigenvector problem, and the new variables are defined by the dataset at hand, not a priori , hence making PCA an adaptive data analysis technique. It is adaptive in another sense too, since variants of the technique have been developed that are tailored to various different data types and structures. This article will begin by introducing the basic ideas of PCA, discussing what it can and cannot do. It will then describe some variants of PCA and their application.
Principal Moment Analysis

Magnus Fontes,Rasmus Henningsson

DOI: https://doi.org/10.48550/arXiv.2003.04208

2020-03-09

Statistics Theory

Abstract:Principal Moment Analysis is a method designed for dimension reduction, analysis and visualization of high dimensional multivariate data. It generalizes Principal Component Analysis and allows for significant statistical modeling flexibility, when approximating an unknown underlying probability distribution, by enabling direct analysis of general approximate measures. Through https://principalmomentanalysis.github.io/ we provide an implementation, together with a graphical user interface, of a simplex based version of Principal Moment Analysis.
Principal Components Analysis in Clinical Studies

Zhongheng Zhang,Adela Castello

DOI: https://doi.org/10.21037/atm.2017.07.12

IF: 3.616

2017-01-01

Annals of Translational Medicine

Abstract:In multivariate analysis, independent variables are usually correlated to each other which can introduce multicollinearity in the regression models. One approach to solve this problem is to apply principal components analysis (PCA) over these variables. This method uses orthogonal transformation to represent sets of potentially correlated variables with principal components (PC) that are linearly uncorrelated. PCs are ordered so that the first PC has the largest possible variance and only some components are selected to represent the correlated variables. As a result, the dimension of the variable space is reduced. This tutorial illustrates how to perform PCA in R environment, the example is a simulated dataset in which two PCs are responsible for the majority of the variance in the data. Furthermore, the visualization of PCA is highlighted.
Genetic and Nongenetic Variation Revealed for the Principal Components of Human Gene Expression

Anita Goldinger,Anjali K. Henders,Allan F. McRae,Nicholas G. Martin,Greg Gibson,Grant W. Montgomery,Peter M. Visscher,Joseph E. Powell,Anjali K Henders,Allan F McRae,Nicholas G Martin,Grant W Montgomery,Peter M Visscher,Joseph E Powell

DOI: https://doi.org/10.1534/genetics.113.153221

IF: 4.402

2013-11-01

Genetics

Abstract:Abstract Principal components analysis has been employed in gene expression studies to correct for population substructure and batch and environmental effects. This method typically involves the removal of variation contained in as many as 50 principal components (PCs), which can constitute a large proportion of total variation present in the data. Each PC, however, can detect many sources of variation, including gene expression networks and genetic variation influencing transcript levels. We demonstrate that PCs generated from gene expression data can simultaneously contain both genetic and nongenetic factors. From heritability estimates we show that all PCs contain a considerable portion of genetic variation while nongenetic artifacts such as batch effects were associated to varying degrees with the first 60 PCs. These PCs demonstrate an enrichment of biological pathways, including core immune function and metabolic pathways. The use of PC correction in two independent data sets resulted in a reduction in the number of cis- and trans-expression QTL detected. Comparisons of PC and linear model correction revealed that PC correction was not as efficient at removing known batch effects and had a higher penalty on genetic variation. Therefore, this study highlights the danger of eliminating biologically relevant data when employing PC correction in gene expression data.

genetics & heredity
When and why are principal component scores a good tool for visualizing high-dimensional data?

Kristoffer Hellton,Magne Thoresen

DOI: https://doi.org/10.1111/sjos.12264

2020-06-10

Abstract:Principal component analysis (PCA) is a popular dimension reduction technique often used to visualize high-dimensional data structures. In genomics, this can involve millions of variables, but only tens to hundreds of observations. Theoretically, such extreme high-dimensionality will cause biased or inconsistent eigenvector estimates, but in practice the principal component scores are used for visualization with great success. In this paper, we explore when and why the classical principal component scores can be used to visualize structures in high-dimensional data, even when there are few observations compared to the number of variables. Our argument is two-fold: First, we argue that eigenvectors related to pervasive signals will have eigenvalues scaling linearly with the number of variables. Second, we prove that for linearly increasing eigenvalues, the sample component scores will be scaled and rotated versions of the population scores, asymptotically. Thus the visual information of the sample scores will be unchanged, even though the sample eigenvectors are biased. In the case of pervasive signals, the principal component scores can be used to visualize the population structures, even in extreme high-dimensional situations.

Statistics Theory
Principal and independent genomic components of brain structure and function

Lennart M. Oblong,Sourena Soheili‐Nezhad,Nicolò Trevisan,Yingjie Shi,Christian F. Beckmann,Emma Sprooten

DOI: https://doi.org/10.1111/gbb.12876

2024-01-17

Genes Brain & Behavior

Abstract:We propose genomic principal and independent component analysis (PCA, ICA) to decompose a large set of univariate genome‐wide association study (GWAS) statistics of multimodal brain traits into more interpretable latent genomic components. Our results indicate that genomic PCA and ICA decompose genetic effects on imaging derived phenotypes from GWAS statistics with high reproducibility by taking advantage of the inherent pleiotropic patterns. Genomic components clustered along the boundaries of neuroimaging modalities. These findings encourage further applications of genomic PCA and ICA as fully data‐driven methods to effectively reduce the dimensionality, enhance the signal to noise ratio and improve interpretability of high‐dimensional multitrait genome‐wide analyses. The highly polygenic and pleiotropic nature of behavioural traits, psychiatric disorders and structural and functional brain phenotypes complicate mechanistic interpretation of related genome‐wide association study (GWAS) signals, thereby obscuring underlying causal biological processes. We propose genomic principal and independent component analysis (PCA, ICA) to decompose a large set of univariate GWAS statistics of multimodal brain traits into more interpretable latent genomic components. Here we introduce and evaluate this novel methods various analytic parameters and reproducibility across independent samples. Two UK Biobank GWAS summary statistic releases of 2240 imaging‐derived phenotypes (IDPs) were retrieved. Genome‐wide beta‐values and their corresponding standard‐error scaled z‐values were decomposed using genomic PCA/ICA. We evaluated variance explained at multiple dimensions up to 200. We tested the inter‐sample reproducibility of output of dimensions 5, 10, 25 and 50. Reproducibility statistics of the respective univariate GWAS served as benchmarks. Reproducibility of 10‐dimensional PCs and ICs showed the best trade‐off between model complexity and robustness and variance explained (PCs: |rz − max| = 0.33, |rraw − max| = 0.30; ICs: |rz − max| = 0.23, |rraw − max| = 0.19). Genomic PC and IC reproducibility improved substantially relative to mean univariate GWAS reproducibility up to dimension 10. Genomic components clustered along neuroimaging modalities. Our results indicate that genomic PCA and ICA decompose genetic effects on IDPs from GWAS statistics with high reproducibility by taking advantage of the inherent pleiotropic patterns. These findings encourage further applications of genomic PCA and ICA as fully data‐driven methods to effectively reduce the dimensionality, enhance the signal to noise ratio and improve interpretability of high‐dimensional multitrait genome‐wide analyses.

behavioral sciences,neurosciences
Dynamic Principal Component Analysis in High Dimensions

Xiaoyu Hu,Fang Yao

DOI: https://doi.org/10.1080/01621459.2022.2115917

IF: 4.369

2024-01-01

Journal of the American Statistical Association

Abstract:Principal component analysis is a versatile tool to reduce dimensionality which has wide applications in statistics and machine learning. It is particularly useful for modeling data in high-dimensional scenarios where the number of variables p is comparable to, or much larger than the sample size n. Despite an extensive literature on this topic, researchers have focused on modeling static principal eigenvectors, which are not suitable for stochastic processes that are dynamic in nature. To characterize the change in the entire course of high-dimensional data collection, we propose a unified framework to directly estimate dynamic eigenvectors of covariance matrices. Specifically, we formulate an optimization problem by combining the local linear smoothing and regularization penalty together with the orthogonality constraint, which can be effectively solved by manifold optimization algorithms. We show that our method is suitable for high-dimensional data observed under both common and irregular designs, and theoretical properties of the estimators are investigated under l_q (0 ≤ q ≤ 1) sparsity. Extensive experiments demonstrate the effectiveness of the proposed method in both simulated and real data examples.
Visualizing genetic constraints

Travis L. Gaydos,Nancy E. Heckman,Mark Kirkpatrick,J. R. Stinchcombe,Johanna Schmitt,Joel Kingsolver,J. S. Marron

DOI: https://doi.org/10.1214/12-AOAS603

2013-12-06

Abstract:Principal Components Analysis (PCA) is a common way to study the sources of variation in a high-dimensional data set. Typically, the leading principal components are used to understand the variation in the data or to reduce the dimension of the data for subsequent analysis. The remaining principal components are ignored since they explain little of the variation in the data. However, evolutionary biologists gain important insights from these low variation directions. Specifically, they are interested in directions of low genetic variability that are biologically interpretable. These directions are called genetic constraints and indicate directions in which a trait cannot evolve through selection. Here, we propose studying the subspace spanned by low variance principal components by determining vectors in this subspace that are simplest. Our method and accompanying graphical displays enhance the biologist's ability to visualize the subspace and identify interpretable directions of low genetic variability that align with simple directions.

Applications
Gene Set Analysis Using Principal Components

Isa Kemal Pakatci,Wei Wang,Leonard McMillan

DOI: https://doi.org/10.1145/1854776.1854822

2010-01-01

Abstract:We present a new method for identifying gene sets associated with labeled samples, where the labels can be case versus control, or genotype differences. Existing approaches to this problem assume that variations observed within a group are due primarily to noise and they, therefore, look for significant mean shifts between groups. Biological evidence suggests variations can also result from the coordination of genes. Our method attempts to identify and assess the significance of changes in gene-gene correlation patterns. We model gene-gene correlations using principal component analysis and compare their significance to a baseline of a linear models generated by random permutations of the sample labels. Simulation results show that our method detects changes that are undetectable by Hotelling's T2 method. Its performance on real data is comparable to existing methods with the additional capability of detecting changes in gene-interactions between sample groups.
Extrinsic Principal Component Analysis

Ka Chun Wong,Vic Patrangenaru,Robert L. Paige,Mihaela Pricop Jeckstadt

DOI: https://doi.org/10.48550/arXiv.2409.03572

2024-10-03

Abstract:One develops a fast computational methodology for principal component analysis on manifolds. Instead of estimating intrinsic principal components on an object space with a Riemannian structure, one embeds the object space in a numerical space, and the resulting chord distance is used. This method helps us analyzing high, theoretically even infinite dimensional data, from a new perspective. We define the extrinsic principal sub-manifolds of a random object on a Hilbert manifold embedded in a Hilbert space, and the sample counterparts. The resulting extrinsic principal components are useful for dimension data reduction. For application, one retains a very small number of such extrinsic principal components for a shape of contour data sample, extracted from imaging data.

Methodology
Principal component analysis improves reliability of epigenetic aging biomarkers

DOI: https://doi.org/10.1038/s43587-022-00253-5

2022-07-16

Nature Aging

Abstract:Epigenetic clocks based on DNA methylation are widely used aging biomarkers, but their utility is limited by technical noise. A method based on principal component analysis produces high-reliability clocks for applications such as longitudinal studies and intervention trials.
Long-Range Interaction Analysis Using Principal Component Analysis

Peng Chen,Bing Wang,Hau-San Wong,De-Shuang Huang

DOI: https://doi.org/10.1109/ijcnn.2006.247054

2006-01-01

Abstract:This paper analyzes the long-range interactions, which plays a fundamental and important role in many biologic fields, between residues in protein using principal component analysis (PCA). Firstly, one angular coordinate system of long-range interaction regions is constructed conveniently. Afterwards, a matrix of the angular values of residues can be analyzed by principal component analysis technique. Projecting the angular matrix onto its eigenvectors, it can be found that the projection is to satisfy Boltzmann distribution. By analyzing the thermodynamic environment of the interaction region and scaling the interaction regions, it can be concluded that the distribution of long-range interactions may also be obtained and as a result applied in prediction of contact map.
A Tutorial on Principal Component Analysis

Jonathon Shlens

DOI: https://doi.org/10.48550/arXiv.1404.1100

IF: 5.414

2014-04-03

Machine Learning

Abstract:Principal component analysis (PCA) is a mainstay of modern data analysis - a black box that is widely used but (sometimes) poorly understood. The goal of this paper is to dispel the magic behind this black box. This manuscript focuses on building a solid intuition for how and why principal component analysis works. This manuscript crystallizes this knowledge by deriving from simple intuitions, the mathematics behind PCA. This tutorial does not shy away from explaining the ideas informally, nor does it shy away from the mathematics. The hope is that by addressing both aspects, readers of all levels will be able to gain a better understanding of PCA as well as the when, the how and the why of applying this technique.
Principal components analysis corrects for stratification in genome-wide association studies

Alkes L Price,Nick J Patterson,Robert M Plenge,Michael E Weinblatt,Nancy A Shadick,David Reich

DOI: https://doi.org/10.1038/ng1847

IF: 30.8

2006-07-23

Nature Genetics

Abstract:Population stratification—allele frequency differences between cases and controls due to systematic ancestry differences—can cause spurious associations in disease studies. We describe a method that enables explicit detection and correction of population stratification on a genome-wide scale. Our method uses principal components analysis to explicitly model ancestry differences between cases and controls. The resulting correction is specific to a candidate marker's variation in frequency across ancestral populations, minimizing spurious associations while maximizing power to detect true associations. Our simple, efficient approach can easily be applied to disease studies with hundreds of thousands of markers.

genetics & heredity
New Interpretation of Principal Components Analysis

Zenon Gniazdowski

DOI: https://doi.org/10.48550/arXiv.1711.10420

2017-11-10

Methodology

Abstract:A new look on the principal component analysis has been presented. Firstly, a geometric interpretation of determination coefficient was shown. In turn, the ability to represent the analyzed data and their interdependencies in the form of easy-to-understand basic geometric structures was shown. As a result of the analysis of these structures it was proposed to enrich the classical PCA. In particular, it was proposed a new criterion for the selection of important principal components and a new algorithm for clustering primary variables by their level of similarity to the principal components. Virtual and real data spaces, as well as tensor operations on data, have also been identified.The anisotropy of the data was identified too.
Inference on the proportion of variance explained in principal component analysis

Ronan Perry,Snigdha Panigrahi,Jacob Bien,Daniela Witten

2024-02-27

Abstract:Principal component analysis (PCA) is a longstanding and well-studied approach for dimension reduction. It rests upon the assumption that the underlying signal in the data has low rank, and thus can be well-summarized using a small number of dimensions. The output of PCA is typically represented using a scree plot, which displays the proportion of variance explained (PVE) by each principal component. While the PVE is extensively reported in routine data analyses, to the best of our knowledge the notion of inference on the PVE remains unexplored. In this paper, we consider inference on the PVE. We first introduce a new population quantity for the PVE with respect to an unknown matrix mean. Critically, our interest lies in the PVE of the sample principal components (as opposed to unobserved population principal components); thus, the population PVE that we introduce is defined conditional on the sample singular vectors. We show that it is possible to conduct inference, in the sense of confidence intervals, p-values, and point estimates, on this population quantity. Furthermore, we can conduct valid inference on the PVE of a subset of the principal components, even when the subset is selected using a data-driven approach such as the elbow rule. We demonstrate the proposed approach in simulation and in an application to a gene expression dataset.

Methodology
AC-PCoA: Adjustment for Confounding Factors Using Principal Coordinate Analysis

Yu Wang,Fengzhu Sun,Wei Lin,Shuqin Zhang

DOI: https://doi.org/10.1371/journal.pcbi.1010184

2022-01-01

Abstract:Confounding factors exist widely in various biological data owing to technical variations, population structures and experimental conditions. Such factors may mask the true signals and lead to spurious associations in the respective biological data, making it necessary to adjust confounding factors accordingly. However, existing confounder correction methods were mainly developed based on the original data or the pairwise Euclidean distance, either one of which is inadequate for analyzing different types of data, such as sequencing data. In this work, we proposed a method called Adjustment for Confounding factors using Principal Coordinate Analysis, or AC-PCoA, which reduces data dimension and extracts the information from different distance measures using principal coordinate analysis, and adjusts confounding factors across multiple datasets by minimizing the associations between lower-dimensional representations and confounding variables. Application of the proposed method was further extended to classification and prediction. We demonstrated the efficacy of AC-PCoA on three simulated datasets and five real datasets. Compared to the existing methods, AC-PCoA shows better results in visualization, statistical testing, clustering, and classification.

What is principal component analysis?

Principal Component Analyses in Anthropological Genetics

[Principal Component Analysis for Exploring Gene Expression Patterns].

Power Analysis of Principal Components Regression in Genetic Association Studies.

Principal component analysis: a review and recent developments

Principal Moment Analysis

Principal Components Analysis in Clinical Studies

Genetic and Nongenetic Variation Revealed for the Principal Components of Human Gene Expression

When and why are principal component scores a good tool for visualizing high-dimensional data?

Principal and independent genomic components of brain structure and function

Dynamic Principal Component Analysis in High Dimensions

Visualizing genetic constraints

Gene Set Analysis Using Principal Components

Extrinsic Principal Component Analysis

Principal component analysis improves reliability of epigenetic aging biomarkers

Long-Range Interaction Analysis Using Principal Component Analysis

A Tutorial on Principal Component Analysis

Principal components analysis corrects for stratification in genome-wide association studies

New Interpretation of Principal Components Analysis

Inference on the proportion of variance explained in principal component analysis

AC-PCoA: Adjustment for Confounding Factors Using Principal Coordinate Analysis