A Quantum Algorithm Framework for Discrete Probability Distributions with Applications to Rényi Entropy Estimation

Xinzhao Wang,Shengyu Zhang,Tongyang Li
DOI: https://doi.org/10.1109/TIT.2024.3382037
2024-04-03
Abstract:Estimating statistical properties is fundamental in statistics and computer science. In this paper, we propose a unified quantum algorithm framework for estimating properties of discrete probability distributions, with estimating Rényi entropies as specific examples. In particular, given a quantum oracle that prepares an $n$-dimensional quantum state $\sum_{i=1}^{n}\sqrt{p_{i}}|i\rangle$, for $\alpha>1$ and $0<\alpha<1$, our algorithm framework estimates $\alpha$-Rényi entropy $H_{\alpha}(p)$ to within additive error $\epsilon$ with probability at least $2/3$ using $\widetilde{\mathcal{O}}(n^{1-\frac{1}{2\alpha}}/\epsilon + \sqrt{n}/\epsilon^{1+\frac{1}{2\alpha}})$ and $\widetilde{\mathcal{O}}(n^{\frac{1}{2\alpha}}/\epsilon^{1+\frac{1}{2\alpha}})$ queries, respectively. This improves the best known dependence in $\epsilon$ as well as the joint dependence between $n$ and $1/\epsilon$. Technically, our quantum algorithms combine quantum singular value transformation, quantum annealing, and variable-time amplitude estimation. We believe that our algorithm framework is of general interest and has wide applications.
Quantum Physics,Data Structures and Algorithms,Information Theory
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to propose a unified quantum algorithm framework for estimating the statistical properties of discrete probability distributions, especially the estimation of α - Rényi entropy. Specifically, given a quantum oracle that can prepare an \(n\)-dimensional quantum state \(\sum_{i = 1}^{n}\sqrt{p_i}|i\rangle\), for \(\alpha>1\) and \(0 < \alpha < 1\), this algorithm framework can estimate the \(\alpha\)-Rényi entropy \(H_{\alpha}(p)\) within an additive error \(\epsilon\) with a probability of at least \(\frac{2}{3}\). The main contribution in the paper lies in improving the dependence on \(n\) and \(\epsilon\) and proposing more efficient quantum query complexity. ### Specific Problem Description 1. **Background and Motivation**: - Quantum algorithms can significantly outperform classical algorithms in many problems, especially in linear algebra problems. The quantum singular value transformation (QSVT) proposed by Gilyén et al. is a powerful framework applicable to various quantum algorithm problems. - The estimation of statistical properties is a fundamental problem in statistics, theoretical computer science, and machine learning. The goal is to estimate the properties of probability distributions with the least number of independent samples. 2. **Specific Problems**: - Estimate the statistical properties of discrete probability distributions, especially the \(\alpha\)-Rényi entropy \(H_{\alpha}(p)\). - The \(\alpha\)-Rényi entropy is defined as: \[ H_{\alpha}(p):=\frac{1}{1 - \alpha}\log\left(\sum_{i = 1}^{n}p_{i}^{\alpha}\right) \] - When \(\alpha\rightarrow1\), \(H_{\alpha}(p)\) approaches the Shannon entropy \(H(p)\). 3. **Existing Work**: - In classical algorithms, the sample complexity for estimating Shannon entropy is \(\Theta\left(\frac{\log^{2}n}{\epsilon^{2}}+\frac{n}{\epsilon\log n}\right)\). - For \(\alpha\)-Rényi entropy, when \(\alpha > 1\) and \(0 < \alpha < 1\), \(O\left(\frac{n}{\log n}\right)\) and \(O\left(\frac{n^{1/\alpha}}{\log n}\right)\) independent samples are required respectively. 4. **Paper Contributions**: - Proposed a unified quantum algorithm framework that combines quantum singular value transformation, quantum annealing, and variable - time amplitude estimation. - Improved the dependence on \(n\) and \(\epsilon\) and proposed more efficient quantum query complexity: - When \(\alpha > 1\), the query complexity is \(\tilde{O}\left(n^{1-\frac{1}{2\alpha}}/\epsilon+\sqrt{n}/\epsilon^{1+\frac{1}{2\alpha}}\right)\). - When \(0 < \alpha < 1\), the query complexity is \(\tilde{O}\left(n^{\frac{1}{2\alpha}}/\epsilon^{1+\frac{1}{2\alpha}}\right)\). 5. **Technical Means**: - Use quantum singular value transformation to calculate