Abstract:This paper addresses the challenge of integrating sequentially arriving data within the quantile regression framework, where the number of features is allowed to grow with the number of observations, the horizon is unknown, and memory is limited. We employ stochastic sub-gradient descent to minimize the empirical check loss and study its statistical properties and regret performance. In our analysis, we unveil the delicate interplay between updating iterates based on individual observations versus batches of observations, revealing distinct regularity properties in each scenario. Our method ensures long-term optimal estimation irrespective of the chosen update strategy. Importantly, our contributions go beyond prior works by achieving exponential-type concentration inequalities and attaining optimal regret and error rates that exhibit only \textsf{ short-term} sensitivity to initial errors. A key insight from our study is the delicate statistical analyses and the revelation that appropriate stepsize schemes significantly mitigate the impact of initial errors on subsequent errors and regrets. This underscores the robustness of stochastic sub-gradient descent in handling initial uncertainties, emphasizing its efficacy in scenarios where the sequential arrival of data introduces uncertainties regarding both the horizon and the total number of observations. Additionally, when the initial error rate is well-controlled, there is a trade-off between short-term error rate and long-term optimality. Due to the lack of delicate statistical analysis for squared loss, we also briefly discuss its properties and proper schemes. Extensive simulations support our theoretical findings.

Local Linear Quantile Regression with Truncated and Dependent Data

Quantile Regression Based on the Weighted Approach with Dependent Truncated Data

Change point estimators by local polynomial fits under a dependence assumption

Local Linear M‐estimation in Non‐parametric Spatial Regression

Nonparametric Estimation of Quantiles for A Class of Stationary Processes

Quantile regression based on the counting process approach under dependent truncated data

Partial functional linear quantile regression

Truncated composite quantile regression with covariates measurement errors

Quantile regression of partially linear single-index model with missing observations

Local linear quantile estimation for nonstationary time series

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Nearly Semiparametric Efficient Estimation of Quantile Regression

Bayesian Quantile Regression for Longitudinal Studies with Nonignorable Missing Data.

Online Quantile Regression

Locally adaptive sparse additive quantile regression model with TV penalty

Flexible Bayesian quantile regression for nonlinear mixed effects models based on the generalized asymmetric Laplace distribution

Quantile regression and empirical likelihood for the analysis of longitudinal data with monotone missing responses due to dropout, with applications to quality of life measurements from clinical trials.

Optimal subsampling for quantile regression in big data

Nonparametric Quantile Regressions for Panel Data Models with Large T

Statistical inference for linear quantile regression with measurement error in covariates and nonignorable missing responses

Sparse quantile regression