Abstract:A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample from the original full sample and uses it as a surrogate for subsequent computation and estimation. In this paper, we study subsampling methods under two scenarios: approximating the full sample ordinary least-square (OLS) estimator and estimating the coefficients in linear regression. We present two algorithms, weighted estimation algorithm and unweighted estimation algorithm, and analyze asymptotic behaviors of their resulting subsample estimators under general conditions. For the weighted estimation algorithm, we propose a criterion for selecting the optimal sampling probability by making use of the asymptotic results. On the basis of the criterion, we provide two novel subsampling methods, the optimal subsampling and the predictor- length subsampling methods. The predictor-length subsampling method is based on the L2 norm of predictors rather than leverage scores. Its computational cost is scalable. For unweighted estimation algorithm, we show that its resulting subsample estimator is not consistent to the full sample OLS estimator. However, it has better performance than the weighted estimation algorithm for estimating the coefficients. Simulation studies and a real data example are used to demonstrate the effectiveness of our proposed subsampling methods.

Model-free Global Likelihood Subsampling for Massive Data

A model robust sub-sampling approach for Generalised Linear Models in Big data settings

Robust and efficient subsampling algorithms for massive data logistic regression

Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data

Subsampling for Big Data Linear Models with Measurement Errors

Optimal Subsampling for Large Sample Logistic Regression

Projection-Uniform Subsampling Methods for Big Data

Optimal Subsampling Algorithms for Big Data Generalized Linear Models

Optimal Subsampling Algorithms for Big Data Generalized Linear Models.

Estimation and testing of expectile regression with efficient subsampling for massive data

Local Uncertainty Sampling for Large-Scale Multi-Class Logistic Regression

Optimal Subsampling Algorithms for Big Data Regressions

Optimal subsampling for modal regression in massive data

Feature Screening for Massive Data Analysis by Subsampling

Sample size determination for multidimensional parameters and the A-optimal subsampling in a big data linear regression model

Multi-resolution subsampling for large-scale linear classification

Optimal Subsampling Approaches for Large Sample Linear Regression

Estimating Extreme Value Index by Subsampling for Massive Datasets with Heavy-Tailed Distributions

Optimal Subsampling for Large-Scale Quantile Regression

Optimal subsampling algorithm for the marginal model with large longitudinal data

Optimal subsampling for parametric accelerated failure time models with massive survival data