Abstract: With the rapid development of data collection and aggregation technologies in many scientific disciplines, it is becoming increasingly ubiquitous to conduct large-scale or online regression to analyze real-world data and unveil real-world evidence. In such applications, it is often numerically challenging or sometimes infeasible to store the entire dataset in memory. Consequently, classical batch-based estimation methods that involve the entire dataset are less attractive or no longer applicable. Instead, recursive estimation methods such as stochastic gradient descent that process data points sequentially are more appealing, exhibiting both numerical convenience and memory efficiency. In this paper, for scalable estimation of large or online survival data, we propose a stochastic gradient descent method which recursively updates the estimates in an online manner as data points arrive sequentially in streams. Theoretical results such as asymptotic normality and estimation efficiency are established to justify its validity. Furthermore, to quantify the uncertainty associated with the proposed stochastic gradient descent estimator and facilitate statistical inference, we develop a scalable resampling strategy that specifically caters to the large-scale or online setting. Simulation studies and a real data application are also provided to assess its performance and illustrate its practical utility.

Two-step online estimation and inference for expected shortfall regression with streaming data

Conditional Tail-Related Risk Estimation Using Composite Asymmetric Least Squares and Empirical Likelihood

Data-driven and distribution-free estimation of tailed-related risks for GARCH models using composite asymmetric least squares regression

Variable Selection in Expectile Regression

Expectile regression for analyzing heteroscedasticity in high dimension

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Renewable estimation in expectile regression model with streaming data sets

Nonparametric Estimation of Expected Shortfall

A new non-parametric estimation of the expected shortfall for dependent financial losses

Optimal nonparametric estimation of the expected shortfall risk

Estimation of and Inference about the Expected Shortfall for Time Series with Infinite Variance

Online Estimation with Rolling Validation: Adaptive Nonparametric Estimation with Streaming Data

Marginal expected shortfall inference under multivariate regular variation

Online Distributional Regression

Statistical Inference for Online Decision Making via Stochastic Gradient Descent

Online updating mode learning for streaming datasets

Nonparametric expected shortfall forecasting incorporating weighted quantiles

Scalable Estimation and Inference with Large-scale or Online Survival Data

Statistical Learning of Value-at-Risk and Expected Shortfall

Adaptive debiased SGD in high-dimensional GLMs with streaming data

Distributed optimization and statistical learning for large-scale penalized expectile regression