Abstract:An envelope is a targeted dimension reduction subspace for simultaneously achieving dimension reduction and improving parameter estimation efficiency. While many envelope methods have been proposed in recent years, all envelope methods hinge on the knowledge of a key hyperparameter, the structural dimension of the envelope. How to estimate the envelope dimension consistently is of substantial interest from both theoretical and practical aspects. Moreover, very recent advances in the literature have generalized envelope as a model-free method, which makes selecting the envelope dimension even more challenging. Likelihood-based approaches such as information criteria and likelihood-ratio tests either cannot be directly applied or have no theoretical justification. To address this critical issue of dimension selection, we propose two unified approaches -- called FG and 1D selections -- for determining the envelope dimension that can be applied to any envelope models and methods. The two model-free selection approaches are based on the two different envelope optimization procedures: the full Grassmannian (FG) optimization and the 1D algorithm (Cook and Zhang, 2016), and are shown to be capable of correctly identifying the structural dimension with a probability tending to 1 under mild moment conditions as the sample size increases. While the FG selection unifies and generalizes the BIC and modified BIC approaches that existing in the literature, and hence provides the theoretical justification of them under weak moment condition and model-free context, the 1D selection is computationally more stable and efficient in finite sample. Extensive simulations and a real data analysis demonstrate the superb performance of our proposals.

Algorithms for Envelope Estimation

General model-free weighted envelope estimation

Model-free Envelope Dimension Selection

Envelopes for elliptical multivariate linear regression

Envelopes for multivariate linear regression with linearly constrained coefficients

Weighted envelope estimation to handle variability in model selection

Envelopes: A new chapter in partial least squares regression

Vector autoregression and envelope model

New Parsimonious Multivariate Spatial Model: Spatial Envelope

Digital Envelope Estimation Via Geometric Properties of an Arbitrary Real Signal

Semiparametric Efficient Dimension Reduction in multivariate regression with an Inner Envelope

Efficient Estimation and Response Variable Selection in Sparse Partial Envelope Model

Scale invariant and efficient estimation for groupwise scaled envelope model

Regularized Operating Envelope with Interpretability and Implementability Constraints

A Numerical Iterative Scheme for Computing Finite Order Rank-One Convex Envelopes

Bayesian inference for multivariate probit model with latent envelope

Envelopes of straight line families in the plane

GET: Global envelopes in R

Reducing Subspace Models for Large-Scale Covariance Regression

Probability-Guaranteed Envelope-Constrained Filtering for Nonlinear Systems Subject to Measurement Outliers

Global simulation envelopes for diagnostic plots in regression models