Abstract:New technologies have produced increasingly complex and massive datasets, such as next generation sequencing and microarray data in biology, dynamic treatment regimes in clinical trials and long-term wide-scale studies in the social sciences. Each study exhibits its unique data structure within individuals, clusters and possibly across time and space. In order to draw valid conclusion from such large dimensional data, we must account for intracluster correlations, varying cluster sizes, and outliers in response and/or covariate domains to achieve valid and efficient inferences. A weighted rank-based method is proposed for selecting variables and estimating parameters simultaneously. The main contribution of the proposed method is four fold: (1) variable selection using adaptive lasso is extended to robust rank regression so that protection against outliers in both response and predictor variables is obtained; (2) within-subject correlations are incorporated so that efficiency of parameter estimation is improved; (3) the computation is convenient via the existing function in statistical software R. (4) the proposed method is proved to have desirable asymptotic properties for fixed number of covariates ( p ). Simulation studies are carried out to evaluate the proposed method for a number of scenarios including the cases when p equals to the number of subjects. The simulation results indicate that the proposed method is efficient and robust. A hormone dataset is analyzed for illustration. By adding additional redundant variables as covariates, the penalty approach and weighting schemes are proven to be effective.

Combined-Penalized Likelihood Estimations with A Diverging Number of Parameters

Variable selection of diverging number of parameters under combined penalized likelihood estimations

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS

SCAD-Ridge Penalized Likelihood Estimators for Ultra-high Dimensional Models

Variable selection via combined penalization in joint mean and variance models

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

SCAD Penalized Rank Regression with a Diverging Number of Parameters.

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

Penalized Sparse Covariance Regression with High Dimensional Covariates

High-dimensional variable selection accounting for heterogeneity in regression coefficients across multiple data sources

Nonconcave Penalized Inverse Regression in Single-Index Models with High Dimensional Predictors

An RKHS-based approach to double-penalized regression in high-dimensional partially linear models

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Quadratic Approximation via the SCAD Penalty with a Diverging Number of Parameters

Variable Selection for Panel Count Data Via Non‐Concave Penalized Estimating Function

Variable Selection Using Penalized Empirical Likelihood

Penalized Generalized Empirical Likelihood with a Diverging Number of General Estimating Equations for Censored Data

Selection Of Risk Factors For Regression Analysis With Missing Data

Efficient and Doubly-Robust Methods for Variable Selection and Parameter Estimation in Longitudinal Data Analysis