Abstract:Uncovering genuine relationships between a response variable of interest and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian literature is well-developed and there are no substantial differences in the model selection consistency results available from the two schools. For the more challenging generalized linear models (GLMs), however, Bayesian model selection consistency results are lacking in several ways. In this paper, we construct a Bayesian posterior distribution using an appropriate data-dependent prior and develop its asymptotic concentration properties using new theoretical techniques. In particular, we leverage Spokoiny's powerful non-asymptotic theory to obtain sharp quadratic approximations of the GLM's log-likelihood function, which leads to tight bounds on the errors associated with the model-specific maximum likelihood estimators and the Laplace approximation of our Bayesian marginal likelihood. In turn, these improved bounds lead to significantly stronger, near-optimal Bayesian model selection consistency results, e.g., far weaker beta-min conditions, compared to those available in the existing literature. In particular, our results are applicable to the Poisson regression model, in which the score function is not sub-Gaussian.

Optimal Poisson subsampling decorrelated score for high-dimensional generalized linear models

Optimal Decorrelated Score Subsampling for Generalized Linear Models with Massive Data

Optimal Subsampling Algorithms for Big Data Generalized Linear Models

Optimal Subsampling Algorithms for Big Data Generalized Linear Models.

Optimal Subsampling for $$L_p$$-Quantile Regression Via Decorrelated Score

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Optimal subsampling algorithm for the marginal model with large longitudinal data

Optimal Subsampling for Large Sample Logistic Regression

An Adaptive Test on High-dimensional Parameters in Generalized Linear Models

A Regularization-Based Adaptive Test for High-Dimensional Generalized Linear Models

Optimal Subsampling for Large-Scale Quantile Regression

Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data

Importance sampling-based gradient method for dimension reduction in Poisson log-normal model

Advances in Bayesian model selection consistency for high-dimensional generalized linear models

Empirical Bayes inference in sparse high-dimensional generalized linear models

Bias-Corrected Inference of High-Dimensional Generalized Linear Models

An Efficient and Robust Variable Selection Method for Longitudinal Generalized Linear Models

More Efficient Estimation for Logistic Regression with Optimal Subsample

Optimal Subsampling Algorithms for Big Data Regressions

Poisson Regression in one Covariate on Massive Data

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization