Abstract:Standard regression techniques model only the mean of the response variable. Quantile regression (QR) is more powerful in that it depicts a comprehensive relationship between the response variable and independent covariates at different quantiles. It is particularly useful for non-normally distributed data with skewness or heterogeneity, which appear routinely in many scientific fields, such as economics, finance, public health and biology. Although its theory has been well developed in the literature, its computation in big data still faces multiple challenges, especially for vertically stored big data in modern distributed environments, where communication efficiency and security are usually the primary considerations. While the popular alternating direction method of multipliers (ADMM) provides a general computational solution, its slow convergence becomes a bottleneck when communication cost dominates local computational consumption, such as Internet of Things (IoT) networks. Motivated by the residual projection technique, in this paper we propose an innovative iterative parallel framework, PIQR, that converges faster and has a more secure data transmission plan, and establish its convergence property. This framework is further extended to composite quantile regression (CQR), a modified QR technique that improves estimation efficiency at extreme quantiles. Simulation studies show that both the ADMM-based method and the PIQR enjoy favorable estimation accuracy in distributed environments. While PIQR is inferior to the ADMM-based method at local computation, it requires much fewer iterations to achieve convergence, and hence significantly improves the overall computational efficiency when communication cost is the dominating factor. Moreover, PIQR transmits only data involving the residual information between different machines, and can better prevent the leakage of important data information compared with the ADMM-based method.

Composite Hierachical Linear Quantile Regression

Estimation of Heteroscedasticity by Local Composite Quantile Regression and Matrix Decomposition

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Composite quantile estimation in partial functional linear regression model with dependent errors

Variable selection via composite quantile regression with dependent errors

Bayesian relative composite quantile regression with ordinal longitudinal data and some case studies

Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data

Composite Quantile Estimation in Partial Functional Linear Regression Model Based on Polynomial Spline

Transfer learning with high dimensional composite quantile regression

Optimal subsampling algorithms for composite quantile regression in massive data

Bayesian composite -quantile regression

Composite Quantile Factor Models

Multiple-output composite quantile regression through an optimal transport lens

Deep Quantile Regression: Mitigating the Curse of Dimensionality Through Composition

Truncated composite quantile regression with covariates measurement errors

Functional-Coefficient Quantile Regression for Panel Data with Latent Group Structure

Residual projection for quantile regression in vertically partitioned big data

Nearly Semiparametric Efficient Estimation of Quantile Regression

High-dimensional varying index coefficient quantile regression model

Residual Normality Assumption and the Estimation of Multiple Membership Random Effects Models