Abstract:This paper identifies that a group of state-of-the-art locally-differentially-private (LDP) algorithms for frequency estimation are equivalent to the private Count-Mean Sketch (CMS) algorithm with different parameters. Therefore, we revisit the private CMS, correct errors in the original CMS paper regarding expectation and variance, modify the CMS implementation to eliminate existing bias, and explore optimized parameters for CMS to achieve optimality in reducing the worst-case mean squared error (MSE), $l_1$ loss, and $l_2$ loss. Additionally, we prove that pairwise-independent hashing is sufficient for CMS, reducing its communication cost to the logarithm of the cardinality of all possible values (i.e., a dictionary). As a result, the aforementioned optimized CMS is proven theoretically and empirically to be the only algorithm optimized for reducing the worst-case MSE, $l_1$ loss, and $l_2$ loss when dealing with a very large dictionary. Furthermore, we demonstrate that randomness is necessary to ensure the correctness of CMS, and the communication cost of CMS, though low, is unavoidable despite the randomness being public or private.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to optimize the Count - Mean Sketch (CMS) algorithm to reduce the mean - squared error (MSE), $l_1$ loss and $l_2$ loss in the worst - case scenario when performing frequency estimation under the protection of Local Differential Privacy (LDP). Specifically, this research focuses on the following points: 1. **Correcting the errors in the original CMS algorithm**: The original LDP - CMS algorithm has errors in calculating the expected value and variance, resulting in biased estimation results. 2. **Optimizing CMS parameters**: By adjusting the parameters of CMS, the algorithm can more effectively reduce the MSE, $l_1$ loss and $l_2$ loss in the worst - case scenario. 3. **Proving the sufficiency of pairwise independent hash functions**: Research shows that pairwise independent hash functions are sufficient to meet the needs of CMS and can reduce the communication cost to the logarithmic level of the dictionary size. 4. **Ensuring the importance of randomness**: Randomness is crucial for ensuring the correctness and performance of CMS. Whether it is public randomness or private randomness, its communication cost is inevitable. ### Specific problem description - **Challenges in frequency estimation**: When data is protected by LDP, direct access to the original data becomes impossible, so frequency estimation becomes more complex. Especially when the dictionary (the set of all possible values) is very large, traditional mechanisms such as random response will cause the variance of the estimate to increase linearly with the dictionary size, making the estimate infeasible. - **Limitations of existing algorithms**: Many existing LDP frequency estimation algorithms have solved some problems, but they still have shortcomings in some cases. For example, some algorithms assume that the estimated frequency is close to zero, and when the actual frequency is close to 1, these algorithms perform poorly; also, some algorithms have high communication costs and cannot be effectively applied to large - scale dictionaries. ### Solutions - **Optimized CMS framework**: The author re - examined the privatized CMS algorithm, corrected the original errors, and proposed a method for optimizing parameters. By using pairwise independent hash functions, the communication cost is reduced, and the effectiveness of the optimized CMS in processing large - scale dictionaries is proved theoretically and experimentally. - **Optimal parameter selection**: By comparing different LDP mechanisms (such as random response, symmetric RAPPOR, etc.), the optimal parameter settings under different conditions are determined, thereby minimizing the MSE, $l_1$ loss and $l_2$ loss in the worst - case scenario. ### Summary of mathematical formulas The MSE, $l_1$ loss and $l_2$ loss of the optimized CMS algorithm in the worst - case scenario are respectively: \[ 'MSE^* = \begin{cases} \frac{2(\Delta_{MSE}+e^\epsilon)}{n(e^\epsilon - 1)^2}, & \text{if } f^*\leq\frac{1}{2} \\ \frac{e^{\epsilon/2}}{n(e^{\epsilon/2}-1)^2}, & \text{if } \frac{1}{2}<f^*\leq1 \end{cases} \] where, \[ \Delta_{MSE}=e^{\epsilon/2}[(1 - f^*)e^\epsilon+f^*][f^*e^\epsilon+(1 - f^*)] \] \[ l_1^*\leq\frac{2d(\Delta_l + d e^\epsilon)}{n(e^\epsilon - 1)^2} \] \[ l_2^*=\frac{2(\Delta_l + d e^\epsilon)}{n(e^\epsilon - 1)^2} \] where, \[ \Delta_l = e^{\epsilon/2}[(

Count-mean Sketch as an Optimized Framework for Frequency Estimation with Local Differential Privacy