Abstract:An envelope is a targeted dimension reduction subspace for simultaneously achieving dimension reduction and improving parameter estimation efficiency. While many envelope methods have been proposed in recent years, all envelope methods hinge on the knowledge of a key hyperparameter, the structural dimension of the envelope. How to estimate the envelope dimension consistently is of substantial interest from both theoretical and practical aspects. Moreover, very recent advances in the literature have generalized envelope as a model-free method, which makes selecting the envelope dimension even more challenging. Likelihood-based approaches such as information criteria and likelihood-ratio tests either cannot be directly applied or have no theoretical justification. To address this critical issue of dimension selection, we propose two unified approaches -- called FG and 1D selections -- for determining the envelope dimension that can be applied to any envelope models and methods. The two model-free selection approaches are based on the two different envelope optimization procedures: the full Grassmannian (FG) optimization and the 1D algorithm (Cook and Zhang, 2016), and are shown to be capable of correctly identifying the structural dimension with a probability tending to 1 under mild moment conditions as the sample size increases. While the FG selection unifies and generalizes the BIC and modified BIC approaches that existing in the literature, and hence provides the theoretical justification of them under weak moment condition and model-free context, the 1D selection is computationally more stable and efficient in finite sample. Extensive simulations and a real data analysis demonstrate the superb performance of our proposals.

Envelopes for elliptical multivariate linear regression

Envelopes for multivariate linear regression with linearly constrained coefficients

Envelopes: A new chapter in partial least squares regression

New Parsimonious Multivariate Spatial Model: Spatial Envelope

General model-free weighted envelope estimation

Semiparametric Efficient Dimension Reduction in multivariate regression with an Inner Envelope

Model-free Envelope Dimension Selection

Weighted envelope estimation to handle variability in model selection

Reduced-rank Envelope Vector Autoregressive Models

Leveraging Mixed and Incomplete Outcomes Via Reduced-Rank Modeling.

Reducing Subspace Models for Large-Scale Covariance Regression

Vector autoregression and envelope model

Efficient Estimation and Response Variable Selection in Sparse Partial Envelope Model

Robust reduced-rank regression

Reduced Rank Multivariate Kernel Ridge Regression

Stepwise regression data envelopment analysis for variable reduction

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression

Scale invariant and efficient estimation for groupwise scaled envelope model

Dimension Reduction for Spatially Correlated Data: Spatial Predictor Envelope

Robust Regularized Low-Rank Matrix Models for Regression and Classification

Bayesian inference for multivariate probit model with latent envelope