Abstract:We propose a novel methodology for drawing iid realizations from any target distribution on the Euclidean space with arbitrary dimension. No assumption of compact support is necessary for the validity of our theory and method. Our idea is to construct an appropriate infinite sequence of concentric closed ellipsoids, represent the target distribution as an infinite mixture on the central ellipsoid and the ellipsoidal annuli, and to construct efficient perfect samplers for the mixture components. In contrast with most of the existing works on perfect sampling, ours is not only a theoretically valid method, it is practically applicable to all target distributions on any dimensional Euclidean space and very much amenable to parallel computation. We validate the practicality and usefulness of our methodology by generating 10000 iid realizations from the standard distributions such as normal, Student's t with 5 degrees of freedom and Cauchy, for dimensions d = 1, 5, 10, 50, 100, as well as from a 50-dimensional mixture normal distribution. The implementation time in all the cases are very reasonable, and often less than a minute in our parallel implementation. The results turned out to be highly accurate. We also apply our method to draw 10000 iid realizations from the posterior distributions associated with the well-known Challenger data, a Salmonella data and the 160-dimensional challenging spatial example of the radionuclide count data on Rongelap Island. Again, we are able to obtain quite encouraging results with very reasonable computing time.

On Low Discrepancy Samplings in Product Spaces of Motion Groups

Low discrepancy sequences in high dimensions: How well are their projections distributed?

Spherical Discrepancy for Designs on Hyperspheres

Sampling in CMA-ES: Low Numbers of Low Discrepancy Points

Transforming the Challenge of Constructing Low-Discrepancy Point Sets into a Permutation Selection Problem

Improving Point Selection in Cubature by a New Discrepancy.

Discrepancy bounds for low-dimensional point sets

Mixture discrepancy for quasi-random point sets

Extensible Grids: Uniform Sampling on a Space-Filling Curve

Expected $L_2-$discrepancy bound for a class of new stratified sampling models

Evolving Distributions Under Local Motion

Random projections of random manifolds

Incremental space-filling design based on coverings and spacings: improving upon low discrepancy sequences

IID Sampling from Intractable Distributions

A dynamical approach to sampling and interpolation in unimodular groups

Exploring Distributional Discrepancy for Multidimensional Point Set Retrieval

Comparison Theorems for the Mixing Times of Systematic and Random Scan Dynamics

Sampling triangulations of manifolds using Monte Carlo methods

Sampling discretization of the uniform norm and applications

SF-SFD: Stochastic Optimization of Fourier Coefficients to Generate Space-Filling Designs

Discrepancy Minimization via a Self-Balancing Walk