Abstract:This work aims to provide an environment for all users who are beginner in the context of the statistical simulation approaches. These techniques are known as the Monte Carlo methods as a whole nowadays. Indeed, the Monte Carlo, as a statistical simulation technique, itself involves the Markov chain Monte Carlo that attracts the attention of researchers from a wide variety of study fields. One may see the Markov chain Monte Carlo as statistical simulation approaches that work based on the iterative algorithms and so the others that are not based on iterative algorithm are the Monte Carlo approaches. We would recommend the reader(s) to learn the elementary undergraduate courses in calculus, probability, and statistics before studying or applying this report for practical purposes. The required topics may include, but not limited to, concept of mathematical function, limit, derivative, partial derivative, simple integrals, probability axioms, discrete and continuous random variables, probability distributions, concept of central tendency and variance, multivariate probability distributions, functions of random variables, and the central limit theorem (CLT).

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to provide an easy - to - understand application environment for statistical simulation methods, especially the Markov Chain Monte Carlo (MCMC) technique in Monte Carlo methods. Specifically, the paper mainly focuses on how to use MCMC techniques, especially Gibbs Sampling, in practical applications, and provides a large number of R - language code examples to help readers better understand these theoretical concepts. ### Overview of the Main Objectives and Contents of the Paper: 1. **Introducing Statistical Simulation Methods**: - Focus on introducing the Monte Carlo method and its subclass - the Markov Chain Monte Carlo (MCMC) technique. - Emphasize the importance of MCMC in various research fields and explain its working principle based on iterative algorithms. 2. **Explaining the Metropolis - Hastings Algorithm in Detail**: - Provide a detailed description of the Metropolis - Hastings algorithm and show how to implement this algorithm in the R environment through specific examples. - Explain the application of symmetric and asymmetric proposal distributions and discuss the improvement of the Adaptive Metropolis - Hastings algorithm. 3. **Discussing Rejection Sampling and Importance Sampling**: - Introduce the basic principles and steps of rejection sampling and illustrate how to choose an appropriate proposal distribution through specific examples. - Explore the application of importance sampling in calculating the cumulative distribution function (CDF), etc. 4. **Discussing Gibbs Sampling in Depth**: - Introduce in detail the working principle of Gibbs Sampling and its application in Bayesian inference. - Discuss the advantages of Gibbs Sampling in dealing with high - dimensional distributions and provide multiple practical application examples, such as generating multivariate Gaussian distribution samples and dealing with truncated distributions. 5. **Application Examples and R Code**: - Provide a large number of R - code examples to help readers understand and apply the above theories in practice. - Demonstrate the performance and results of the algorithms through specific charts and data visualizations. ### Summary: This paper aims to provide beginners with a comprehensive and easy - to - understand guide to help them master statistical simulation methods, especially MCMC techniques and Gibbs Sampling. Through detailed theoretical explanations and rich practical examples, readers can better understand these complex techniques and apply them to practical problems.

Digesting Gibbs Sampling Using R

Inference from Iterative Simulation Using Multiple Sequences

Markov chain Monte Carlo methods in biostatistics

Data Analysis Recipes: Using Markov Chain Monte Carlo

Sampling algorithms in statistical physics: a guide for statistics and machine learning

Sampling-Based Approaches to Calculating Marginal Densities

Diffusive Gibbs Sampling

Stochastic Gradient Markov Chain Monte Carlo

Insufficient Gibbs sampling

Sampling Algorithms, from Survey Sampling to Monte Carlo Methods: Tutorial and Literature Review

On particle Gibbs sampling

Multi-level methods and approximating distribution functions

Adapting The Gibbs Sampler

Sampling from Dirichlet process mixture models with unknown concentration parameter: Mixing issues in large data implementations

On Gibbs Sampling Architecture for Labeled Random Finite Sets Multi-Object Tracking

Markov Chain Monte Carlo in Practice

Accelerated Markov Chain Monte Carlo Using Adaptive Weighting Scheme

Markov-Normal analysis of iterative simulations before their convergence

Simulation based sequential Monte Carlo methods for discretely observed Markov processes

Rolling the DICE (Design, Interpret, Compute, Estimate): Interactive Learning of Biostatistics With Simulations

A Single Series from the Gibbs Sampler Provides a False Sense of Security *