Abstract:In this paper, we study streaming algorithms that minimize the number of changes made to their internal state (i.e., memory contents). While the design of streaming algorithms typically focuses on minimizing space and update time, these metrics fail to capture the asymmetric costs, inherent in modern hardware and database systems, of reading versus writing to memory. In fact, most streaming algorithms write to their memory on every update, which is undesirable when writing is significantly more expensive than reading. This raises the question of whether streaming algorithms with small space and number of memory writes are possible. We first demonstrate that, for the fundamental $F_p$ moment estimation problem with $p\ge 1$, any streaming algorithm that achieves a constant factor approximation must make $\Omega(n^{1-1/p})$ internal state changes, regardless of how much space it uses. Perhaps surprisingly, we show that this lower bound can be matched by an algorithm that also has near-optimal space complexity. Specifically, we give a $(1+\varepsilon)$-approximation algorithm for $F_p$ moment estimation that uses a near-optimal $\widetilde{\mathcal{O}}_\varepsilon(n^{1-1/p})$ number of state changes, while simultaneously achieving near-optimal space, i.e., for $p\in[1,2]$, our algorithm uses $\text{poly}\left(\log n,\frac{1}{\varepsilon}\right)$ bits of space, while for $p>2$, the algorithm uses $\widetilde{\mathcal{O}}_\varepsilon(n^{1-2/p})$ space. We similarly design streaming algorithms that are simultaneously near-optimal in both space complexity and the number of state changes for the heavy-hitters problem, sparse support recovery, and entropy estimation. Our results demonstrate that an optimal number of state changes can be achieved without sacrificing space complexity.

Improved Algorithms for White-Box Adversarial Streams

Fast White-Box Adversarial Streaming Without a Random Oracle

Adversarially Robust Dense-Sparse Tradeoffs via Heavy-Hitters

Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams

Spectral Guarantees for Adversarial Streaming PCA

Revisiting Co-Occurring Directions: Sharper Analysis and Efficient Algorithm for Sparse Matrices.

Rivalry of Two Families of Algorithms for Memory-Restricted Streaming PCA

A Strong Separation for Adversarially Robust $\ell_0$ Estimation for Linear Sketches

Dancing with Shackles, Meet the Challenge of Industrial Adaptive Streaming Via Offline Reinforcement Learning

Streaming Algorithms with Few State Changes

Variational Bayesian Inference for Robust Streaming Tensor Factorization and Completion

Low-Memory Algorithms for Online and W-Streaming Edge Coloring

Streaming Graph Computations with a Helpful Advisor

Meta-theorems for Parameterized Streaming Algorithms

Streaming Algorithms for Graph k-Matching with Optimal or Near-Optimal Update Time

Robust Factorization and Completion of Streaming Tensor Data via Variational Bayesian Inference

New Algorithms and Lower Bounds for Streaming Tournaments

Approximating Element-Wise Functions of Matrix with Improved Streaming Randomized SVD

Improved Deterministic Streaming Algorithms for Non-monotone Submodular Maximization

Streaming PCA and Subspace Tracking: The Missing Data Case

Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors