Abstract:We study critera for a pair $ (\{ X_n \} $, $ \{ Y_n \}) $ of approximating processes which guarantee closeness of moments by generalizing known results for the special case that $ Y_n = Y $ for all $n$ and $ X_n $ converges to $Y$ in probability. This problem especially arises when working with surrogate models, e.g. to enrich observed data by simulated data, where the surrogates $Y_n$'s are constructed to justify that they approximate the $ X_n $'s.
The results of this paper deal with sequences of random variables. Since this framework does not cover many applications where surrogate models such as deep neural networks are used to approximate more general stochastic processes, we extend the results to the more general framework of random fields of stochastic processes. This framework especially covers image data and sequences of images. We show that uniform integrability is sufficient, and this holds even for the case of processes provided they satisfy a weak stationarity condition.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to ensure the closeness between the moments of the approximation process and those of the original stochastic process when using approximation processes (such as surrogate models). Specifically, the author studies a pair of approximation processes $\{X_n\}$ and $\{Y_n\}$, and under what conditions the closeness between the moments of $\{Y_n\}$ and those of $\{X_n\}$ can be guaranteed. This problem is particularly important in practical applications. For example, in fields such as data science, deep learning, and uncertainty quantification, it is often necessary to enrich the observed data through simulated data, and these simulated data are usually generated by surrogate models.
### Main Contributions
1. **Conditions for Moment Convergence**: The paper explores under what conditions, if $\{X_n\}$ converges to $X$, and $\{Y_n\}$ is an approximation of $\{X_n\}$, then the gap between the moments of $\{Y_n\}$ and those of $\{X_n\}$ will tend to zero.
2. **The Role of Uniform Integrability**: The author proves that uniform integrability is a key condition for ensuring moment convergence. Specifically, if both $\{X_n\}$ and $\{Y_n\}$ are uniformly integrable, and $\{Y_n\}$ approximates $\{X_n\}$, then the gap between the moments of $\{Y_n\}$ and those of $\{X_n\}$ will tend to zero.
3. **Extension to Random Fields**: The paper also extends the results to a more general random field framework, which covers application scenarios such as high - dimensional settings and image data.
### Key Theorems
- **Theorem 2.1**: Suppose $0 < r <\infty$. If $\{|X_n|^r : n\geq1\}$ and $\{|Y_n|^r : n\geq1\}$ are uniformly integrable, and $|X_n - Y_n|\xrightarrow{P}0$, then:
- $E|X_n - Y_n|^r\rightarrow0$, when $0 < r\leq1$;
- $|E|X_n|^r - E|Y_n|^r|\rightarrow0$, when $0 < r\leq1$;
- $|E(X_n) - E(Y_n)|\rightarrow0$, when $r = 1$;
- $|(E|X_n|^r)^{1/r}-(E|Y_n|^r)^{1/r}|\rightarrow0$, when $0 < r <\infty$.
- **Theorem 3.1**: Suppose $0 < r <\infty$. If $\{X_n(\lambda):n\geq1,\lambda\in\Lambda\}$ and $\{Y_n(\lambda):n\geq1,\lambda\in\Lambda\}$ satisfy strict marginal stationarity conditions, and $\{|X_n(\lambda)|^r : n\geq1\}$ and $\{|Y_n(\lambda)|^r : n\geq1\}$ are uniformly integrable, and $\sup_{\lambda\in\Lambda}|X_n(\lambda)-Y_n(\lambda)|\xrightarrow{P}0$, then:
- $\sup_{\lambda\in\Lambda}E|X_n(\lambda)-Y_n(\lambda)|^r\rightarrow0$, when $0 < r\leq1$;
- $\sup_{\lambda\in\Lambda}|E|X_n(\lambda)|^r - E|Y_n(\lambda)|^r|\rightarrow0$, when $0 < r\leq1$;
- $\sup_{\lambda\in\Lambda}\cdots$