Abstract:Standard regression techniques model only the mean of the response variable. Quantile regression (QR) is more powerful in that it depicts a comprehensive relationship between the response variable and independent covariates at different quantiles. It is particularly useful for non-normally distributed data with skewness or heterogeneity, which appear routinely in many scientific fields, such as economics, finance, public health and biology. Although its theory has been well developed in the literature, its computation in big data still faces multiple challenges, especially for vertically stored big data in modern distributed environments, where communication efficiency and security are usually the primary considerations. While the popular alternating direction method of multipliers (ADMM) provides a general computational solution, its slow convergence becomes a bottleneck when communication cost dominates local computational consumption, such as Internet of Things (IoT) networks. Motivated by the residual projection technique, in this paper we propose an innovative iterative parallel framework, PIQR, that converges faster and has a more secure data transmission plan, and establish its convergence property. This framework is further extended to composite quantile regression (CQR), a modified QR technique that improves estimation efficiency at extreme quantiles. Simulation studies show that both the ADMM-based method and the PIQR enjoy favorable estimation accuracy in distributed environments. While PIQR is inferior to the ADMM-based method at local computation, it requires much fewer iterations to achieve convergence, and hence significantly improves the overall computational efficiency when communication cost is the dominating factor. Moreover, PIQR transmits only data involving the residual information between different machines, and can better prevent the leakage of important data information compared with the ADMM-based method.

Developing Choropleth Maps of Parameter Results for Quantile Regression

Mapping Local Regression for Spatial Object-Pairs

Understanding City-Wide Ride-Sourcing Travel Flow: A Geographically Weighted Regression Approach

Local Linear M‐estimation in Non‐parametric Spatial Regression

High-Dimensional Spatial Quantile Function-on-Scalar Regression

A Local Polycategorical Approach to Areal Interpolation.

Interquantile Shrinkage in Spatial Quantile Autoregressive Regression models

SMOOTH DENSITY SPATIAL QUANTILE REGRESSION

Distributed Quantile Regression over Sensor Networks

Estimating spatial quantile regression with functional coefficients: A robust semiparametric framework

Geographically Weighted Regression Analysis for Spatial Economics Data: a Bayesian Recourse

A Spatiotemporal Regression-Kriging Model for Space-Time Interpolation: a Case Study of Chlorophyll-a Prediction in the Coastal Areas of Zhejiang, China.

Functional data analysis of generalized regression quantiles

Multi-Reservoir Water Quality Mapping from Remote Sensing Using Spatial Regression

Geographically Weighted Regression in Geospatial Analysis

Quantile Surfaces -- Generalizing Quantile Regression to Multivariate Targets

Instrumental Variable Quantile Estimation of Spatial Autoregressive Models

Residual projection for quantile regression in vertically partitioned big data

Global quantile regression

Covariate-distance Weighted Regression (CWR): A Case Study for Estimation of House Prices

A backfitting maximum likelihood estimator for hierarchical and geographically weighted regression modelling, with a case study of house prices in Beijing