Abstract:An envelope is a targeted dimension reduction subspace for simultaneously achieving dimension reduction and improving parameter estimation efficiency. While many envelope methods have been proposed in recent years, all envelope methods hinge on the knowledge of a key hyperparameter, the structural dimension of the envelope. How to estimate the envelope dimension consistently is of substantial interest from both theoretical and practical aspects. Moreover, very recent advances in the literature have generalized envelope as a model-free method, which makes selecting the envelope dimension even more challenging. Likelihood-based approaches such as information criteria and likelihood-ratio tests either cannot be directly applied or have no theoretical justification. To address this critical issue of dimension selection, we propose two unified approaches -- called FG and 1D selections -- for determining the envelope dimension that can be applied to any envelope models and methods. The two model-free selection approaches are based on the two different envelope optimization procedures: the full Grassmannian (FG) optimization and the 1D algorithm (Cook and Zhang, 2016), and are shown to be capable of correctly identifying the structural dimension with a probability tending to 1 under mild moment conditions as the sample size increases. While the FG selection unifies and generalizes the BIC and modified BIC approaches that existing in the literature, and hence provides the theoretical justification of them under weak moment condition and model-free context, the 1D selection is computationally more stable and efficient in finite sample. Extensive simulations and a real data analysis demonstrate the superb performance of our proposals.

Scaled Partial Envelope Model in Multivariate Linear Regression

Envelopes for multivariate linear regression with linearly constrained coefficients

Scale invariant and efficient estimation for groupwise scaled envelope model

Efficient Estimation and Response Variable Selection in Sparse Partial Envelope Model

Envelopes for elliptical multivariate linear regression

Envelopes: A new chapter in partial least squares regression

New Parsimonious Multivariate Spatial Model: Spatial Envelope

Bayesian inference for multivariate probit model with latent envelope

Model-free Envelope Dimension Selection

General model-free weighted envelope estimation

Weighted envelope estimation to handle variability in model selection

Vector autoregression and envelope model

Semiparametric Efficient Dimension Reduction in multivariate regression with an Inner Envelope

Reducing Subspace Models for Large-Scale Covariance Regression

Reduced-rank Envelope Vector Autoregressive Models

Sequential scaled sparse factor regression

Scaled sparse linear regression

Variable selection for partially linear models via partial correlation

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Large System Of Seemingly Unrelated Regressions: A Penalized Quasi-Maximum Likelihood Estimation Perspective

Empirical-Likelihood-Based Inference for Partially Linear Models