Abstract:Gaussian approximations are routinely employed in Bayesian statistics to ease inference when the target posterior is intractable. Although these approximations are asymptotically justified by Bernstein-von Mises type results, in practice the expected Gaussian behavior may poorly represent the shape of the posterior, thus affecting approximation accuracy. Motivated by these considerations, we derive an improved class of closed-form approximations of posterior distributions which arise from a new treatment of a third-order version of the Laplace method yielding approximations in a tractable family of skew-symmetric distributions. Under general assumptions which account for misspecified models and non-i.i.d. settings, this family of approximations is shown to have a total variation distance from the target posterior whose rate of convergence improves by at least one order of magnitude the one established by the classical Bernstein-von Mises theorem. Specializing this result to the case of regular parametric models shows that the same improvement in approximation accuracy can be also derived for polynomially bounded posterior functionals. Unlike other higher-order approximations, our results prove that it is possible to derive closed-form and valid densities which are expected to provide, in practice, a more accurate, yet similarly-tractable, alternative to Gaussian approximations of the target posterior, while inheriting its limiting frequentist properties. We strengthen such arguments by developing a practical skew-modal approximation for both joint and marginal posteriors that achieves the same theoretical guarantees of its theoretical counterpart by replacing the unknown model parameters with the corresponding MAP estimate. Empirical studies confirm that our theoretical results closely match the remarkable performance observed in practice, even in finite, possibly small, sample regimes.

Likelihood Based Inference for the Shape Parameter of the Inverse Gaussian Distribution

Likelihood Based Inference for the Shape Parameter of the Inverse Gaussian Distribution

Empirical Likelihood Based Inference for Conditional Pareto-type Tail Index

Empirical Likelihood Inference for Probability Density Functions under Association

Statistical Inference for the Shape Parameter Change-Point Estimator in Negative Associated Gamma Distribution

Inferences on the common mean of several inverse Gaussian populations

Inferences on the difference and ratio of the means of two inverse Gaussian distributions

Efficient likelihood-based inference for the generalized Pareto distribution

Inverse Gaussian Process regression for likelihood-free inference

Inference on order restricted means of inverse Gaussian populations under heteroscedasticity

STATISTICAL INFERENCE BASED ON THE LENGTH-BIASED DATA FOR THE INVERSE GAUSSIAN DISTRIBUTION

Improved likelihood inference in generalized linear models

A new goodness-of-fit test for the inverse Gaussian distribution

Likelihood-based Spacings Goodness-of-Fit Statistics for Univariate Shape-constrained Densities

Semiparametrically efficient rank-based inference for shape II. Optimal R-estimation of shape

Maximum likelihood estimation of the parameters of the inverse Gaussian distribution using maximum rank set sampling with unequal samples

Empirical-Likelihood-Based Inference for Partially Linear Models

Skewed Bernstein-von Mises theorem and skew-modal approximations

Variational Inference based on a Subclass of Closed Skew Normals

Sub-Gaussian Error Bounds for Hypothesis Testing