Complete Asymptotic Analysis for Projected Stochastic Approximation and Debiased Variants
Jiadong Liang,Yuze Han,Xiang Li,Zhihua Zhang
DOI: https://doi.org/10.1109/Allerton58177.2023.10313416
2023-01-01
Abstract:In this study, we investigate distributed optimization through the lens of linearly constrained optimization problems and analyze the loopless projection stochastic approximation (LPSA) method. LPSA incorporates a probabilistic projection, denoted as p
<inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf>
, during the n-th iteration to ensure random feasibility. We set ${p_n} \propto \eta _n^\beta $, where η
<inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf>
represents the step size and β is a tuning parameter. Our previous research demonstrates that LPSA exhibits a fascinating bias-variance trade-off through diffusion approximation in the asymptotic regime. Specifically, for β < 0.5, the bias becomes degenerate, while for β > 0.5, the bias dominates the variance. In this work, we investigate the intricate scenario where β = 0.5 and discover that the last iterate, after appropriate scaling, weakly converges to a biased Gaussian distribution. As a result, we provide a comprehensive asymptotic analysis of LPSA and a complete characterization of phase transitions. We observe that a non-zero bias leads to slow convergence. Motivated by this observation, we propose a debiased version of LPSA, called Debiased LPSA (DLPSA), which effectively reduces projection complexity compared to the vanilla LPSA.