Abstract:Establishing a low-dimensional representation of the data leads to efficient data learning strategies. In many cases, the reduced dimension needs to be explicitly stated and estimated from the data. We explore the estimation of dimension in finite samples as a constrained optimization problem, where the estimated dimension is a maximizer of a penalized profile likelihood criterion within the framework of a probabilistic principal components analysis. Unlike other penalized maximization problems that require an ‘optimal’ penalty tuning parameter, we propose a data-averaging procedure whereby the estimated dimension emerges as the most favourable choice over a range of plausible penalty parameters. The proposed heuristic is compared to a large number of alternative criteria in simulations and an application to gene expression data. Extensive simulation studies reveal that none of the methods uniformly dominate the other and highlight the importance of subject-specific knowledge in choosing statistical methods for dimension learning. Our application results also suggest that gene expression data have a higher intrinsic dimension than previously thought. Overall, our proposed heuristic strikes a good balance and is the method of choice when model assumptions deviated moderately.

Enhanced Model Predictions through Principal Components and Average Least Squares-Centered Penalized Regression

Enhancing model predictions through the fusion of stein estimator and principal component regression

Author Response for "partial Least Median of Squares Regression"

Principal Model Analysis Based on Partial Least Squares

Principal components regression estimator of the parameters in partially linear models

Structured Principal Component Analysis Model With Variable Correlation Constraint

Exploring Dimension Learning Via a Penalized Probabilistic Principal Component Analysis

Principal Components Regression Estimation in Semiparametric Partially Linear Additive Models

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

Principal Component Regression by Principal Component Selection

A principal-weighted penalized regression model and its application in economic modeling

Penalized spline models for functional principal component analysis

Principal component analysis balancing prediction and approximation accuracy for spatial data

Maximally Correlated Principal Component Analysis Based on Deep Parameterization Learning.

Penalized Sparse Covariance Regression with High Dimensional Covariates

On sufficient dimension reduction via principal asymmetric least squares

Two Classes of Almost Unbiased Type Principal Component Estimators in Linear Regression Model

Targeted principal components regression

Principal Fitted Components for Dimension Reduction in Regression

Improvement of simultaneous prediction using principal components approach

Penalized Partial Least Squares Based on B-Splines Transformations