Abstract:In this paper, we study streaming algorithms that minimize the number of changes made to their internal state (i.e., memory contents). While the design of streaming algorithms typically focuses on minimizing space and update time, these metrics fail to capture the asymmetric costs, inherent in modern hardware and database systems, of reading versus writing to memory. In fact, most streaming algorithms write to their memory on every update, which is undesirable when writing is significantly more expensive than reading. This raises the question of whether streaming algorithms with small space and number of memory writes are possible. We first demonstrate that, for the fundamental $F_p$ moment estimation problem with $p\ge 1$, any streaming algorithm that achieves a constant factor approximation must make $\Omega(n^{1-1/p})$ internal state changes, regardless of how much space it uses. Perhaps surprisingly, we show that this lower bound can be matched by an algorithm that also has near-optimal space complexity. Specifically, we give a $(1+\varepsilon)$-approximation algorithm for $F_p$ moment estimation that uses a near-optimal $\widetilde{\mathcal{O}}_\varepsilon(n^{1-1/p})$ number of state changes, while simultaneously achieving near-optimal space, i.e., for $p\in[1,2]$, our algorithm uses $\text{poly}\left(\log n,\frac{1}{\varepsilon}\right)$ bits of space, while for $p>2$, the algorithm uses $\widetilde{\mathcal{O}}_\varepsilon(n^{1-2/p})$ space. We similarly design streaming algorithms that are simultaneously near-optimal in both space complexity and the number of state changes for the heavy-hitters problem, sparse support recovery, and entropy estimation. Our results demonstrate that an optimal number of state changes can be achieved without sacrificing space complexity.

Stream quantiles via maximal entropy histograms

Two maximum entropy based algorithms for running quantile estimation in non-stationary data streams

Optimal Quantile Approximation in Streams

A Fast Algorithm for Approximate Quantiles in High Speed Data Streams

Non‐crossing quantile double‐autoregression for the analysis of streaming time series data

An efficient algorithm for approximate biased quantile computation in data streams.

Bounded Space Differentially Private Quantiles

Renewable Quantile Regression with Heterogeneous Streaming Datasets

Streaming Algorithms with Few State Changes

SQUAD: Combining Sketching and Sampling Is Better than Either for Per-item Quantile Estimation

Efficient and Secure Quantile Aggregation of Private Data Streams

Relative Error Streaming Quantiles

Using Exponential Histograms to Approximate the Quantiles of Heavy- and Light-Tailed Data

Optimal quantile estimation: beyond the comparison model

InQMAD: Incremental Quantum Measurement Anomaly Detection

Unconditional Quantile Regression for Streaming Datasets

Fine-grained Probability Counting for Cardinality Estimation of Data Streams.

Online Residual Quantization Via Streaming Data Correlation Preserving

A Very Efficient Scheme for Estimating Entropy of Data Streams Using Compressed Counting

Optimal One-pass Nonparametric Estimation Under Memory Constraint

Dimensionless Anomaly Detection on Multivariate Streams with Variance Norm and Path Signature