Abstract:We study the Markov chain Monte Carlo (MCMC) estimator for numerical integration for functions that do not need to be square integrable w.r.t. the invariant distribution. For chains with a spectral gap we show that the absolute mean error for $L^p$ functions, with $p \in (1,2)$, decreases like $n^{1/p -1}$, which is known to be the optimal rate. This improves currently known results where an additional parameter $\delta>0$ appears and the convergence is of order $n^{(1+\delta)/p-1}$.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about the convergence rate of Markov chain Monte Carlo (MCMC) methods in numerical integration for functions with unbounded second - order moments. Specifically, the author studies the optimal convergence rate of the absolute mean error for functions in the Lp space (1 < p < 2) under the condition of Markov chains with spectral gaps.
### Problem Background
In the MCMC method, it is usually necessary to estimate the expected value under a certain target distribution π:
\[ E[f(X)]=\int_X f(x)\pi(dx)=\pi(f) \]
where \( f:X\rightarrow\mathbb{R} \) is a measurable and π - integrable function. To approximate this expected value, a common method is to construct a Markov chain \((X_n)_{n\in\mathbb{N}}\) with π as the invariant distribution and estimate it through the sample mean:
\[ S_n f=\frac{1}{n}\sum_{j = 1}^n f(X_j) \]
### Existing Problems
For square - integrable functions (i.e., functions with finite second - order moments), existing research has shown that the convergence rate of the mean squared error (MSE) is \( n^{-1/2} \). However, for functions whose second - order moments may be unbounded, especially when \( p\in(1,2) \), the current results usually have an additional parameter δ, making the convergence rate \( n^{(1 + \delta)/p-1} \). This is not optimal.
### Core Contributions of the Paper
The main contribution of this paper is to prove that under the spectral gap condition, for Lp functions with \( p\in(1,2] \), the optimal convergence rate of the absolute mean error (AME) is \( n^{1/p - 1} \), thus removing the additional parameter δ in the previous results. Specifically, the author proves the following conclusion:
\[ \sup_{\|f\|_{L_p(\pi)}\leq1}E[|S_n f-\pi(f)|]\leq\tilde{C}_p\cdot n^{1/p - 1} \]
where \(\tilde{C}_p\) is an explicit constant.
### Method Overview
The author finally arrives at the above conclusion by using the Riesz - Thorin interpolation theorem and combining some intermediate results (such as lemmas and propositions). The specific steps include:
1. **Lemma 3.1**: Prove the upper bound of the mean squared error for stationary chains (with the initial distribution being π) and centered functions h.
2. **Proposition 3.2**: Use Lemma 3.1 and the Riesz - Thorin interpolation theorem to obtain the upper bound of the absolute mean error for Lp functions.
3. **Theorem 2.3**: Generalize the result to the case of general initial distribution ν by using the technique of changing measures.
### Conclusions
This paper successfully improves the existing results and proves that under the spectral gap condition, for Lp functions (1 < p ≤ 2), the optimal convergence rate of the absolute mean error of MCMC integration is \( n^{1/p - 1} \). This result fills the theoretical gap and provides more accurate error estimates for practical applications.
### References
The paper cites a large number of relevant literatures, covering multiple fields from Markov chain theory to numerical analysis, ensuring the rigor and wide applicability of the results.