Abstract:There are many scenarios such as the electronic health records where the outcome is much more difficult to collect than the covariates. In this paper, we consider the linear regression problem with such a data structure under the high dimensionality. Our goal is to investigate when and how the unlabeled data can be exploited to improve the estimation and inference of the regression parameters in linear models, especially in light of the fact that such linear models may be misspecified in data analysis. In particular, we address the following two important questions. (1) Can we use the labeled data as well as the unlabeled data to construct a semi-supervised estimator such that its convergence rate is faster than the supervised estimators? (2) Can we construct confidence intervals or hypothesis tests that are guaranteed to be more efficient or powerful than the supervised estimators? To address the first question, we establish the minimax lower bound for parameter estimation in the semi-supervised setting. We show that the upper bound from the supervised estimators that only use the labeled data cannot attain this lower bound. We close this gap by proposing a new semi-supervised estimator which attains the lower bound. To address the second question, based on our proposed semi-supervised estimator, we propose two additional estimators for semi-supervised inference, the efficient estimator and the safe estimator. The former is fully efficient if the unknown conditional mean function is estimated consistently, but may not be more efficient than the supervised approach otherwise. The latter usually does not aim to provide fully efficient inference, but is guaranteed to be no worse than the supervised approach, no matter whether the linear model is correctly specified or the conditional mean function is consistently estimated.

Inference for High‐dimensional Linear Models with Locally Stationary Error Processes

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Local Linear M‐estimation in Non‐parametric Spatial Regression

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Local linear M-estimation for spatial processes in fixed-design models

Inference in High-Dimensional Linear Measurement Error Models

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Local Linear Estimation for Regression Models with Locally Stationary Long Memory Errors

Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models

Spatial local M-estimation under association

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Simultaneous Inference for High-Dimensional Linear Models

One-Step Regularized Estimator for High-Dimensional Regression Models

Inference in High-dimensional Multivariate Response Regression with Hidden Variables

Double-Estimation-Friendly Inference for High Dimensional Misspecified Measurement Error Models

Robust Inference for High‐dimensional Single Index Models

Statistical Inference for Multivariate Longitudinal Data with Irregular Auto-Correlated Error Process

Parametric Inference in Stationary Time Series Models with Dependent Errors

Inference on High-dimensional Single-index Models with Streaming Data

Optimal Semi-supervised Estimation and Inference for High-dimensional Linear Regression

A Perturbation Method for Inference on Regularized Regression Estimates