Abstract:New technologies have produced increasingly complex and massive datasets, such as next generation sequencing and microarray data in biology, dynamic treatment regimes in clinical trials and long-term wide-scale studies in the social sciences. Each study exhibits its unique data structure within individuals, clusters and possibly across time and space. In order to draw valid conclusion from such large dimensional data, we must account for intracluster correlations, varying cluster sizes, and outliers in response and/or covariate domains to achieve valid and efficient inferences. A weighted rank-based method is proposed for selecting variables and estimating parameters simultaneously. The main contribution of the proposed method is four fold: (1) variable selection using adaptive lasso is extended to robust rank regression so that protection against outliers in both response and predictor variables is obtained; (2) within-subject correlations are incorporated so that efficiency of parameter estimation is improved; (3) the computation is convenient via the existing function in statistical software R. (4) the proposed method is proved to have desirable asymptotic properties for fixed number of covariates ( p ). Simulation studies are carried out to evaluate the proposed method for a number of scenarios including the cases when p equals to the number of subjects. The simulation results indicate that the proposed method is efficient and robust. A hormone dataset is analyzed for illustration. By adding additional redundant variables as covariates, the penalty approach and weighting schemes are proven to be effective.

SCAD Penalized Rank Regression with a Diverging Number of Parameters.

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Variable Selection in Expectile Regression

Expectile regression for analyzing heteroscedasticity in high dimension

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Rank-based Variable Selection with Censored Data

Variable Selection for the Partial Linear Single-Index Model

Least Squares Approximation with a Diverging Number of Parameters

Variable selection and estimation via SCAD-type penalty for censored regression models

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Semi-Smooth Newton Algorithm for Non-Convex Penalized Linear Regression

Penalized Sparse Covariance Regression with High Dimensional Covariates

Variable Selection in Rank Regression for Analyzing Longitudinal Data

Variable Selection for Linear Mixed Effects Model Via Penalization Approaches

Efficient and Doubly-Robust Methods for Variable Selection and Parameter Estimation in Longitudinal Data Analysis

Shrinkage Tuning Parameter Selection with A Diverging Number of Parameters

Consistent Tuning Parameter Selection in High Dimensional Sparse Linear Regression

Penalized robust estimators in logistic regression with applications to sparse models