Fundamental bounds for parameter estimation with few measurements

Valentin Gebhart,Manuel Gessner,Augusto Smerzi

2024-02-22

Abstract:Bounding the optimal precision in parameter estimation tasks is of central importance for technological applications. In the regime of a small number of measurements, or that of low signal-to-noise ratios, the meaning of common frequentist bounds such as the Cramér-Rao bound (CRB) become questionable. Here, we discuss different linear (Barankin-like) conditions that can be imposed on estimators and analyze when these conditions admit an optimal estimator with finite variance, for any number of measurement repetitions. We show that, if the number of imposed conditions is larger than the number of measurement outcomes, there generally does not exist a corresponding estimator with finite variance. We analyze this result from different viewpoints and examples and elaborate on connections to the shot-noise limit and the Kitaev phase estimation algorithm. We then derive an extended Cramér-Rao bound that is compatible with a finite variance in situations where the Barankin bound is undefined. Finally, we show an exemplary numerical confrontation between frequentist and Bayesian approaches to parameter estimation.

Quantum Physics

What problem does this paper attempt to address?

### The problems the paper attempts to solve

This paper explores the problem of the optimal precision limit in parameter estimation with a small number of measurements. Specifically, when the number of measurements or the signal - to - noise ratio is low, the significance of common frequentist bounds (such as the Cramér - Rao Bound (CRB)) becomes doubtful. The author discusses different linear conditions (similar to the Barankin conditions) that can be imposed on estimators and analyzes when these conditions allow the existence of an optimal estimator with a finite variance.

### Main content

1. **Background introduction**:
- Parameter estimation theory aims to infer unknown parameters from statistical data. It is a core part of inferential statistics and is widely used in physics, engineering, medicine and other fields.
- Two key concepts in the frequentist method are Fisher information and the Cramér - Rao Bound (CRB), which set fundamental limits on the estimation precision of unknown parameters.
- The CRB requires that the estimator satisfies certain conditions and provides a precision bound, but this bound can only be reached in the case of multiple repeated measurements or a high signal - to - noise ratio.

2. **Research motivation**:
- When the number of measurements is small, the applicability of the CRB is limited. Therefore, subsequent research has analyzed optimal parameter estimation strategies under different stronger conditions and has been extended to the quantum domain.
- This paper focuses on analyzing the existence of optimal estimators that satisfy different linear unbiased conditions when the number of measurements is small and each measurement result is limited.

3. **Main results**:
- If the number of imposed conditions is greater than the number of measurement results, generally there is no estimator with a finite variance.
- The author analyzes this result through multiple examples and perspectives and explores the connections with the shot - noise limit and the Kitaev phase - estimation algorithm.
- An extended Cramér - Rao Bound (eCRB) is derived, which is still compatible with a finite variance when the Barankin bound is not defined.

4. **Numerical comparison**:
- The author compares the performance of the frequentist method and the Bayesian method in parameter estimation through numerical experiments, especially the differences in the case of a small number of measurements.
- For example, for the zero - click probability estimation of the Poisson distribution, the Barankin bound, the variance of the maximum - likelihood estimator (MLE), and the Bayesian variance are compared.

### Formula summary

- **Mean - square error**:
\[
(\Delta \theta_{\text{est}})^2=\sum_x p(x|\theta)(\theta_{\text{est}}(x)-\langle\theta_{\text{est}}\rangle_\theta)^2
\]
where \(\langle\theta_{\text{est}}\rangle_\theta = \sum_x p(x|\theta)\theta_{\text{est}}(x)\).

- **Linear constraint**:
\[
\lambda=\sum_{x\in X^+}g(x)(\theta_{\text{est}}(x)-\langle\theta_{\text{est}}\rangle_\theta)
\]
where \(g(x)\) is a test function corresponding to the bias \(\lambda\), and \(X^+\) is the set of all measurement results with non - zero probability.

- **Variance lower bound**:
\[
(\Delta \theta_{\text{est}})^2_C=\sup_{a\in\mathbb{R}^n}\frac{(a^\top\lambda)^2}{a^\top C a}=\lambda^\top C^{-1}\lambda
\]
where \(C_{kl}=\sum_{x\in X^+}\frac{g_k(x)g_l(x)}{p(x|\theta)}\).