Stein Estimation for Infinitely Divisible Laws

R. Averkamp,C. Houdré
2004-12-17
Abstract: Unbiased risk estimation, à la Stein, is studied for infinitely divisible laws with finite second moment.
Statistics Theory,Probability
What problem does this paper attempt to address?
The problem that the paper "Stein Estimation for Infinitely Divisible Laws" attempts to solve is how to perform unbiased risk estimation within the framework of infinitely divisible distributions (with finite second - order moments). Specifically, the authors explore how to use the Stein method to perform unbiased risk estimation of location parameters in infinitely divisible distributions, which is an important problem in statistics, especially when dealing with non - Gaussian noise data. ### Background and Motivation In statistics, the Stein estimation method is a technique for evaluating the performance of estimators, especially for the mean estimation of multivariate normal distributions. Stein's method allows us to construct an unbiased risk estimator, which is crucial for selecting the optimal estimator. However, when the data does not follow a normal distribution, how to construct a similar unbiased risk estimator is a challenge. ### Main Contributions 1. **Generalize Stein Estimation**: The paper generalizes the Stein estimation method from normal distributions to more general infinitely divisible distributions. Infinitely divisible distributions are an important class of probability distributions, which can be represented as the limit distributions of the sum of independent and identically distributed random variables, such as Poisson processes, stable distributions, etc. 2. **Construct an Unbiased Risk Estimator**: The authors propose an operator \( K_f \), which can transform the original problem into a convolution form, making unbiased risk estimation possible. Specifically, for a given estimation function \( g \), an operator \( K_f \) can be used to construct a function \( h \), such that the expectation of \( h \) is equal to the risk of \( g \). 3. **Application Examples**: The paper provides several specific examples, showing how to apply this method in different distributions (such as Laplace distribution, Gamma distribution, hyperbolic cosine distribution, etc.). These examples not only verify the theoretical results but also provide guidance for practical applications. ### Formulas and Derivations The paper uses some key formulas to derive the unbiased risk estimator: - **Stein Formula**: \[ E\left\|X + \theta + g(X + \theta) - \theta\right\|^2_2 = n\sigma^2 + E\left\|g(X + \theta)\right\|^2_2 + 2\sigma^2 E \sum_{i = 1}^n \frac{\partial}{\partial x_i} g_i(X + \theta) \] - **Operator \( K_f \)**: \[ \hat{K}_f(g)(w) = \frac{\hat{g}(w) \hat{f}'(-w)}{i \hat{f}(-w)} \] - **Unbiased Risk Estimation**: \[ \int_{\mathbb{R}} h(x + \theta) f(x) \, dx = \int_{\mathbb{R}} x g(x + \theta) f(x) \, dx \] ### Conclusion By introducing the operator \( K_f \), the authors successfully generalize the Stein estimation method to infinitely divisible distributions. This method is not only of great theoretical significance but also provides an effective tool for dealing with non - Gaussian noise data in practical applications. In particular, in fields such as wavelet denoising, this unbiased risk estimation method can significantly improve the accuracy of estimation.