Abstract:An envelope is a targeted dimension reduction subspace for simultaneously achieving dimension reduction and improving parameter estimation efficiency. While many envelope methods have been proposed in recent years, all envelope methods hinge on the knowledge of a key hyperparameter, the structural dimension of the envelope. How to estimate the envelope dimension consistently is of substantial interest from both theoretical and practical aspects. Moreover, very recent advances in the literature have generalized envelope as a model-free method, which makes selecting the envelope dimension even more challenging. Likelihood-based approaches such as information criteria and likelihood-ratio tests either cannot be directly applied or have no theoretical justification. To address this critical issue of dimension selection, we propose two unified approaches -- called FG and 1D selections -- for determining the envelope dimension that can be applied to any envelope models and methods. The two model-free selection approaches are based on the two different envelope optimization procedures: the full Grassmannian (FG) optimization and the 1D algorithm (Cook and Zhang, 2016), and are shown to be capable of correctly identifying the structural dimension with a probability tending to 1 under mild moment conditions as the sample size increases. While the FG selection unifies and generalizes the BIC and modified BIC approaches that existing in the literature, and hence provides the theoretical justification of them under weak moment condition and model-free context, the 1D selection is computationally more stable and efficient in finite sample. Extensive simulations and a real data analysis demonstrate the superb performance of our proposals.

Scale invariant and efficient estimation for groupwise scaled envelope model

A Two-Step Estimation Method for Grouped Data with Connections to the Extended Growth Curve Model and Partial Least Squares Regression.

Expectile regression for analyzing heteroscedasticity in high dimension

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Weighted envelope estimation to handle variability in model selection

General model-free weighted envelope estimation

Adaptive Shrinkage Estimation of High Dimensional Moment Condition Model with Smooth Structural Changes

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

Sieve Estimation of Time-Varying Panel Data Models With Latent Structures

A High-dimensional M-estimator Framework for Bi-level Variable Selection

Envelopes for multivariate linear regression with linearly constrained coefficients

Using generalized estimating equations to estimate nonlinear models with spatial data

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Efficient Estimation and Response Variable Selection in Sparse Partial Envelope Model

Efficient estimation in semivarying coefficient models for longitudinal/clustered data

Mixture Envelope Model for Heterogeneous Genomics Data Analysis

Simultaneous estimation and group identification for network vector autoregressive model with heterogeneous nodes

Model-free Envelope Dimension Selection

Group Regularized Estimation under Structural Hierarchy

Homogeneity and Sparsity Analysis for High-Dimensional Panel Data Models

Group Structure Detection for a High‐dimensional Panel Data Model