Abstract:This paper proposes a multi-stage projection-based Lasso procedure for the semiparametric sample selection model in high-dimensional settings under a weak nonparametric restriction on the selection correction. In particular, the number of regressors in the main equation, p, and the number of regressors in the selection equation, d, can grow with and exceed the sample size n. The analysis considers the exact sparsity case and the approximate sparsity case. The main theoretical results are finite-sample bounds from which sufficient scaling conditions on the sample size for estimation consistency and variable-selection consistency are established. Statistical efficiency of the proposed estimators is studied via lower bounds on minimax risks and the result shows that, for a family of models with exactly sparse structure on the coefficient vector in the main equation, one of the proposed estimators attains the smallest estimation error up to the (n,d,p)-scaling among a class of procedures in worst-case scenarios. Inference procedures for the coefficients of the main equation, one based on a pivotal Dantzig selector to construct non-asymptotic confidence sets and one based on a post-selection strategy, are discussed. Other theoretical contributions include establishing the non-asymptotic counterpart of the familiar asymptotic oracle results from previous literature: the estimator of the coefficients in the main equation behaves as if the unknown nonparametric component were known, provided the nonparametric component is sufficiently smooth. Small-sample performance of the high-dimensional multi-stage estimation procedure is evaluated by Monte-Carlo simulations and illustrated with an empirical application to the retail gasoline market in the Greater Saint Louis area.

Inertial Regularization and Selection (IRS): Sequential Regression in High-Dimension and Sparsity

Regularization and variable selection for infinite variance autoregressive models

Regularized DeepIV with Model Selection

Consistent Tuning Parameter Selection in High Dimensional Sparse Linear Regression

Bayesian variable selection in linear regression models with instrumental variables

Spatially Regularized Streaming Sensor Selection

Online sparse sliced inverse regression for high-dimensional streaming data

Inference on High-dimensional Single-index Models with Streaming Data

Information Directed Sampling for Sparse Linear Bandits

A Unified Dynamic Approach to Sparse Model Selection

Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization

Incremental Regularized Least Squares for Dimensionality Reduction of Large-Scale Data.

High-Dimensional Semiparametric Selection Models: Estimation Theory with an Application to the Retail Gasoline Market

Post Selection Shrinkage Estimation for High Dimensional Data Analysis

Regularized Matrix Regression

An RKHS-based approach to double-penalized regression in high-dimensional partially linear models

Regularized Estimation in High-Dimensional Vector Auto-Regressive Models using Spatio-Temporal Information

Non-asymptotic model selection for linear non least-squares estimation in regression models and inverse problems

Online updating mode learning for streaming datasets