Abstract:The textbook literature of principal components analysis (PCA) dates from a period when statistical computing was much less powerful than it is today and the dimensionality of data sets typically processed by PCA correspondingly much lower. When the formulas in those textbooks involve limiting properties of PCA descriptors, the limit involved is usually the indefinite increase of sample size for a fixed roster of variables. But contemporary applications of PCA in organismal systems biology, particularly in geometric morphometrics (GMM), generally involve much greater counts of variables. The way one might expect pure noise to degrade the biometric signal in this more contemporary context is described by a different mathematical literature concerned with the situation where the count of variables itself increases while remaining proportional to the count of specimens. The founders of this literature established a result of startling simplicity. Consider steadily larger and larger data sets consisting of completely uncorrelated standardized Gaussians (mean zero, variance 1) such that the ratio of variables to cases (the so-called “p/n ratio”) is fixed at a value y. Then the largest eigenvalue of their covariance matrix tends to (1+y)2$$(1+\sqrt{y})^2$$, the smallest tends to (1-y)2$$(1-\sqrt{y})^2$$, and their ratio tends to the limiting value ((1+y)/(1-y))2$$\bigl((1+\sqrt{y})\bigm/(1-\sqrt{y})\bigr)^2$$, whereas in the uncorrelated model both of these eigenvalues and also their ratio should be just 1.0. For y=1/4,$$y={1/4},$$ not an atypical value for GMM data sets, this ratio is 9; for y=1/2,$$y={1/2},$$ which is still not atypical, it is 34. These extrema and ratios, easily confirmed in simulations of realistic size and consistent with real GMM findings in typical applied settings, bear severe negative implications for any technique that involves inverting a covariance structure on shape coordinates, including multiple regression on shape, discriminant analysis by shape, canonical variates analysis of shape, covariance distance analysis from shape, and maximum-likelihood estimation of shape distributions that are not constrained by strong prior models. The theorem also suggests that we should use extreme caution whenever considering a biological interpretation of any Partial Least Squares analysis involving large numbers of landmarks or semilandmarks. I illuminate these concerns with the aid of one simulation, two explicit reanalyses of previously published data, and several little sermons.

Visualizing genetic constraints

Principal Component Analyses in Anthropological Genetics

Genetic Variation, Simplicity, and Evolutionary Constraints for Function-Valued Traits

When and why are principal component scores a good tool for visualizing high-dimensional data?

Power Analysis of Principal Components Regression in Genetic Association Studies.

3D graphical visualization of the genetic architectures underlying complex traits in multiple environments

Detecting Genomic Signatures of Natural Selection with Principal Component Analysis: Application to the 1000 Genomes Data

Principal component analysis and the locus of the Frechet mean in the space of phylogenetic trees

Principal Components Analysis in Clinical Studies

Genetic and Nongenetic Variation Revealed for the Principal Components of Human Gene Expression

Principal component analysis revisited: fast multi-trait genetic evaluations with smooth convergence

Principal component analysis: a review and recent developments

Mapping the genetic architecture of complex traits in experimental populations.

Dissecting genetic correlation and pleiotropy through a genetic cross

ACE of Space: Estimating Genetic Components of High-Dimensional Imaging Data

A spectral graph approach to discovering genetic ancestry

A Newly Noticed Formula Enforces Fundamental Limits on Geometric Morphometric Analyses

Principal component analysis revisited: fast multitrait genetic evaluations with smooth convergence

Sparse Principal Component Analysis

Principal component analysis and clustering on manifolds

Unifying approaches from statistical genetics and phylogenetics for mapping phenotypes in structured populations