Abstract:Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to the medical advances, the number of fixed effect covariates collected from each patient can be quite large, e.g. data on gene expressions of each patient, and all of these variables are not necessarily important for the outcome. So, it is very important to choose the relevant covariates correctly for obtaining the optimal inference for the overall study. On the other hand, the relevant random effects will often be low-dimensional and pre-specified. In this paper, we consider regularized selection of important fixed effect variables in linear mixed-effects models along with maximum penalized likelihood estimation of both fixed and random effect parameters based on general non-concave penalties. Asymptotic and variable selection consistency with oracle properties are proved for low-dimensional cases as well as for high-dimensionality of non-polynomial order of sample size (number of parameters is much larger than sample size). We also provide a suitable computationally efficient algorithm for implementation. Additionally, all the theoretical results are proved for a general non-convex optimization problem that applies to several important situations well beyond the mixed model set-up (like finite mixture of regressions etc.) illustrating the huge range of applicability of our proposal.

Quasi-maximum likelihood estimation and penalized estimation under non-standard conditions

Local quasi-likelihood with a parametric guide

Quasi-likelihood Bridge Estimators for High-Dimensional Generalized Linear Models

Non-Concave Penalization in Linear Mixed-Effects Models and Regularized Selection of Fixed Effects

Minimal penalty for Goldenshluger-Lepski method

Asymptotic Properties of Estimation in Generalized Partial Linear Mixed Models

Large System Of Seemingly Unrelated Regressions: A Penalized Quasi-Maximum Likelihood Estimation Perspective

Estimation and Variable Selection in Generalized Partially Nonlinear Models with Nonignorable Missing Responses

Variable Selection Based on Quasi Likelihood for Generalized Linear Models

NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS

Penalized asymptotic likelihood approach for linear transformation model selection

MM for Penalized Estimation

Variable Selection Using Penalized Empirical Likelihood

Asymptotic Results for Penalized Quasi-Likelihood Estimation in Generalized Linear Mixed Models

Penalized Empirical Likelihood for Quantile Regression with Missing Covariates and Auxiliary Information

Strong Convergence Rates of the Maximum Quasi-Likelihood Estimator in Generalized Linear Models

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

Robust and sparse estimators for linear regression models

Penalized Generalized Empirical Likelihood with a Diverging Number of General Estimating Equations for Censored Data

A penalized simulated maximum likelihood approach in parameter estimation for stochastic differential equations.

Combining Quasi and Empirical Likelihoods in Generalized Linear Models with Missing Responses.