Abstract:We study the error of reversible Markov chain Monte Carlo methods for approximating the expectation of a function. Explicit error bounds with respect to different norms of the function are proven. By the estimation the well known asymptotical limit of the error is attained, i.e. there is no gap between the estimate and the asymptotical behavior. We discuss the dependence of the error on a burn-in of the Markov chain. Furthermore we suggest and justify a specific burn-in for optimizing the algorithm.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: when using the Markov Chain Monte Carlo (MCMC) method to approximately calculate the function expectation, how to provide explicit bounds on the error. Specifically, the author aims to derive explicit upper bounds on the error for functions under different norms (such as ℓ2-, ℓ4- and ℓ∞- norms), and these bounds can reach the known optimal limits in the asymptotic case.
In the paper, the error \(e_\nu(S_{n,n_0}, f)\) between the sample average \(S_n, n_0(f)\) generated by the Markov chain and the true expectation \(S(f)\) is studied, where \(n\) is the number of samples and \(n_0\) is the burn - in number of steps. By analyzing the spectral properties and convergence speed of the Markov chain, the author draws the following conclusions:
1. **Asymptotic behavior**:
- When \(n \to \infty\), the limit of the error \(n \cdot e_\nu(S_{n,n_0}, f)^2\) is:
\[
\lim_{n \to \infty} n \cdot e_\nu(S_{n,n_0}, f)^2=\sum_{k = 1}^{|D|-1}|a_k|^2\frac{1+\beta_k}{1-\beta_k}
\]
where \(a_k=\langle f, u_k\rangle_\pi\), \(u_k\) is the eigenvector of the Markov chain, and \(\beta_k\) is the corresponding eigenvalue.
2. **Explicit error bounds**:
- For \(f\in\ell_2\):
\[
e_\nu(S_{n,n_0}, f)^2\leq\frac{2}{n(1 - \beta_1)}\|f\|_2^2+\frac{2C\beta^{n_0}}{n^2(1-\beta)^2}\|f\|_2^2
\]
- For \(f\in\ell_4\):
\[
e_\nu(S_{n,n_0}, f)^2\leq\frac{2}{n(1 - \beta_1)}\|f\|_4^2+\frac{16\sqrt{2}C\beta^{n_0}}{n^2(1-\beta)(1-\sqrt{\beta})}\|f\|_4^2
\]
- For \(f\in\ell_\infty\):
\[
e_\nu(S_{n,n_0}, f)^2\leq\frac{2}{n(1 - \beta_1)}\|f\|_\infty^2+\frac{4C\beta^{n_0}}{n^2(1-\beta)^2}\|f\|_\infty^2
\]
3. **Choice of burn - in number of steps**:
- The paper suggests choosing \(n_0=\max\left\{\left\lceil\frac{\log(C)}{\log(\beta^{-1})}\right\rceil, 0\right\}\) to optimize the algorithm performance so that the error bound is as small as possible.
Through these results, the paper not only provides the error bounds of the MCMC method in the case of a finite number of samples, but also provides a theoretical basis for parameter selection (such as the burn - in number of steps \(n_0\) and the number of samples \(n\)) in practical applications.