Abstract:Gaussian approximations are routinely employed in Bayesian statistics to ease inference when the target posterior is intractable. Although these approximations are asymptotically justified by Bernstein-von Mises type results, in practice the expected Gaussian behavior may poorly represent the shape of the posterior, thus affecting approximation accuracy. Motivated by these considerations, we derive an improved class of closed-form approximations of posterior distributions which arise from a new treatment of a third-order version of the Laplace method yielding approximations in a tractable family of skew-symmetric distributions. Under general assumptions which account for misspecified models and non-i.i.d. settings, this family of approximations is shown to have a total variation distance from the target posterior whose rate of convergence improves by at least one order of magnitude the one established by the classical Bernstein-von Mises theorem. Specializing this result to the case of regular parametric models shows that the same improvement in approximation accuracy can be also derived for polynomially bounded posterior functionals. Unlike other higher-order approximations, our results prove that it is possible to derive closed-form and valid densities which are expected to provide, in practice, a more accurate, yet similarly-tractable, alternative to Gaussian approximations of the target posterior, while inheriting its limiting frequentist properties. We strengthen such arguments by developing a practical skew-modal approximation for both joint and marginal posteriors that achieves the same theoretical guarantees of its theoretical counterpart by replacing the unknown model parameters with the corresponding MAP estimate. Empirical studies confirm that our theoretical results closely match the remarkable performance observed in practice, even in finite, possibly small, sample regimes.

Bernstein-type approximation of set-valued functions in the symmetric difference metric

Metric Approximation of Set-Valued Functions of Bounded Variation by Integral Operators

Metric Fourier approximation of set-valued functions of bounded variation

Approximation of Functions by a New Class of Generalized Bernstein–Schurer Operators

The pointwise limit of metric integral operators approximating set-valued functions

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

Bernstein–Walsh Theory Associated to Convex Bodies and Applications to Multivariate Approximation Theory

Multivariate Approximating Averages

On the approximation of vector-valued functions by volume sampling

Bernstein-Walsh theory associated to convex bodies and applications to multivariate approximation theory

Approximation of discontinuous functions by positive linear operators. A probabilistic approach

Approximation by a new kind of -Bernstein–Kantorovich operators

Bernstein approximation and beyond: proofs by means of elementary probability theory

Strong Converse Inequality for Weighted Approximation of Functions by the Szász–Mirakjan–Kantorovich Operator

Skewed Bernstein-von Mises theorem and skew-modal approximations

Approximation by bivariate Bernstein–Kantorovich–Stancu operators that reproduce exponential functions

Approximation by α-Bernstein-Kantorovich Type Operators for Functions of One and Two Variables

Approximation processes by multidimensional Bernstein-type exponential polynomials on the hypercube

Exponential sum approximations of finite completely monotonic functions

Kantorovich-Stancu type (α,λ,s) - Bernstein operators and their approximation properties

Average Sampling in Shift Invariant Subspaces with Symmetric Averaging Functions