Abstract:Standard regression techniques model only the mean of the response variable. Quantile regression (QR) is more powerful in that it depicts a comprehensive relationship between the response variable and independent covariates at different quantiles. It is particularly useful for non-normally distributed data with skewness or heterogeneity, which appear routinely in many scientific fields, such as economics, finance, public health and biology. Although its theory has been well developed in the literature, its computation in big data still faces multiple challenges, especially for vertically stored big data in modern distributed environments, where communication efficiency and security are usually the primary considerations. While the popular alternating direction method of multipliers (ADMM) provides a general computational solution, its slow convergence becomes a bottleneck when communication cost dominates local computational consumption, such as Internet of Things (IoT) networks. Motivated by the residual projection technique, in this paper we propose an innovative iterative parallel framework, PIQR, that converges faster and has a more secure data transmission plan, and establish its convergence property. This framework is further extended to composite quantile regression (CQR), a modified QR technique that improves estimation efficiency at extreme quantiles. Simulation studies show that both the ADMM-based method and the PIQR enjoy favorable estimation accuracy in distributed environments. While PIQR is inferior to the ADMM-based method at local computation, it requires much fewer iterations to achieve convergence, and hence significantly improves the overall computational efficiency when communication cost is the dominating factor. Moreover, PIQR transmits only data involving the residual information between different machines, and can better prevent the leakage of important data information compared with the ADMM-based method.

Feature-splitting algorithms for ultrahigh dimensional quantile regression

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Residual projection for quantile regression in vertically partitioned big data

Nonparametric screening for additive quantile regression in ultra-high dimension

Partition-Insensitive Parallel ADMM Algorithm for High-dimensional Linear Models

Quantile Regression for Functional Partially Linear Model in Ultra-High Dimensions

An Alternative Approach to Functional Linear Partial Quantile Regression

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Communication-Efficient Nonparametric Quantile Regression via Random Features

Distributed quantile regression for massive heterogeneous data

Improved Algorithms for High-Dimensional Robust Pca

Online Quantile Regression

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

High-dimensional Quantile Tensor Regression

Robust integrative analysis via quantile regression with homogeneity and sparsity

Decentralized Smoothing ADMM for Quantile Regression with Non-Convex Sparse Penalties

Two‐Stage Estimation for Ultrahigh Dimensional Sparse Quadratic Discriminant Analysis

Efficient Strongly Polynomial Algorithms for Quantile Regression

Inference for Partially Linear Quantile Regression Models in Ultrahigh Dimension