Abstract:Standard regression techniques model only the mean of the response variable. Quantile regression (QR) is more powerful in that it depicts a comprehensive relationship between the response variable and independent covariates at different quantiles. It is particularly useful for non-normally distributed data with skewness or heterogeneity, which appear routinely in many scientific fields, such as economics, finance, public health and biology. Although its theory has been well developed in the literature, its computation in big data still faces multiple challenges, especially for vertically stored big data in modern distributed environments, where communication efficiency and security are usually the primary considerations. While the popular alternating direction method of multipliers (ADMM) provides a general computational solution, its slow convergence becomes a bottleneck when communication cost dominates local computational consumption, such as Internet of Things (IoT) networks. Motivated by the residual projection technique, in this paper we propose an innovative iterative parallel framework, PIQR, that converges faster and has a more secure data transmission plan, and establish its convergence property. This framework is further extended to composite quantile regression (CQR), a modified QR technique that improves estimation efficiency at extreme quantiles. Simulation studies show that both the ADMM-based method and the PIQR enjoy favorable estimation accuracy in distributed environments. While PIQR is inferior to the ADMM-based method at local computation, it requires much fewer iterations to achieve convergence, and hence significantly improves the overall computational efficiency when communication cost is the dominating factor. Moreover, PIQR transmits only data involving the residual information between different machines, and can better prevent the leakage of important data information compared with the ADMM-based method.

Distributed quantile regression for massive heterogeneous data

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Distributed Quantile Regression over Sensor Networks

Distributed Online Quantile Regression over Networks with Quantized Communication.

Distributed High-Dimensional Quantile Regression: Estimation Efficiency and Support Recovery

Optimal subsampling algorithm for composite quantile regression with distributed data

Distributed High-dimensional Regression under a Quantile Loss Function

Communication-Efficient Nonparametric Quantile Regression via Random Features

Online Quantile Regression

Residual projection for quantile regression in vertically partitioned big data

Optimal subsampling algorithms for composite quantile regression in massive data

Regression via Arbitrary Quantile Modeling

Transfer Learning for High-dimensional Quantile Regression with Distribution Shift

Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data

Distributed optimization and statistical learning for large-scale penalized expectile regression

Communication-efficient estimation and inference for high-dimensional quantile regression based on smoothed decorrelated score

Distributed Subgradient Method with Random Quantization and Flexible Weights: Convergence Analysis.

Renewable Quantile Regression with Heterogeneous Streaming Datasets

A Note on Distributed Quantile Regression by Pilot Sampling and One-Step Updating

Optimal subsampling for large‐sample quantile regression with massive data

Optimal Subsampling for Large-Scale Quantile Regression