Abstract:Standard regression techniques model only the mean of the response variable. Quantile regression (QR) is more powerful in that it depicts a comprehensive relationship between the response variable and independent covariates at different quantiles. It is particularly useful for non-normally distributed data with skewness or heterogeneity, which appear routinely in many scientific fields, such as economics, finance, public health and biology. Although its theory has been well developed in the literature, its computation in big data still faces multiple challenges, especially for vertically stored big data in modern distributed environments, where communication efficiency and security are usually the primary considerations. While the popular alternating direction method of multipliers (ADMM) provides a general computational solution, its slow convergence becomes a bottleneck when communication cost dominates local computational consumption, such as Internet of Things (IoT) networks. Motivated by the residual projection technique, in this paper we propose an innovative iterative parallel framework, PIQR, that converges faster and has a more secure data transmission plan, and establish its convergence property. This framework is further extended to composite quantile regression (CQR), a modified QR technique that improves estimation efficiency at extreme quantiles. Simulation studies show that both the ADMM-based method and the PIQR enjoy favorable estimation accuracy in distributed environments. While PIQR is inferior to the ADMM-based method at local computation, it requires much fewer iterations to achieve convergence, and hence significantly improves the overall computational efficiency when communication cost is the dominating factor. Moreover, PIQR transmits only data involving the residual information between different machines, and can better prevent the leakage of important data information compared with the ADMM-based method.

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Distributed quantile regression for massive heterogeneous data

Wild bootstrap inference for penalized quantile regression for longitudinal data

Distributed High-Dimensional Quantile Regression: Estimation Efficiency and Support Recovery

Cluster-Robust Bootstrap Inference in Quantile Regression Models

Communication-efficient Estimation of High-Dimensional Quantile Regression

Sparse and Debiased Lasso Estimation and Inference for High-Dimensional Composite Quantile Regression with Distributed Data

Communication-Efficient Modeling with Penalized Quantile Regression for Distributed Data

Distributed Online Quantile Regression over Networks with Quantized Communication.

Distributed High-dimensional Regression under a Quantile Loss Function

Distributed Statistical Estimation in Quantile Regression over a Network

Communication-efficient estimation and inference for high-dimensional quantile regression based on smoothed decorrelated score

Multi-round Smoothed Composite Quantile Regression for Distributed Data

Optimal subsampling algorithm for composite quantile regression with distributed data

Communication-efficient Estimation of Quantile Matrix Regression for Massive Datasets

Distributed Quantile Regression over Sensor Networks

Smoothed quantile regression with large-scale inference

Communication-efficient Sparse Composite Quantile Regression for Distributed Data

Communication-Efficient Nonparametric Quantile Regression via Random Features

Penalized Quantile Regression for Distributed Big Data Using the Slack Variable Representation.

Residual projection for quantile regression in vertically partitioned big data