Abstract:Due to some widely known critiques of traditional hypothesis testing, Bayesian hypothesis testing using the Bayes factor has been considered as a better alternative. Previous research about the influence of the prior focuses on the prior for the effect size and there is a debate about how to specify the prior. Thus, the focus of this paper is to explore the impact of different priors on the population mean and variance separately (separate priors) on the Bayes factor, and compare the separate priors with the priors on the effect size. Our simulation results show that both the prior distributions on mean and variance have a considerable influence on the Bayes factor, and different types of priors (different separate priors and priors on the effect size) have different influence patterns. We also find that regardless of separate priors or priors on the effect size, and shapes and centers of the priors, different priors could yield similar Bayes factors. Because noninformative prior distributions bias the Bayes factor in support of the null hypothesis, and very informative priors could be risky, we suggest that researchers use weakly informative priors as reasonable priors and they are expected to provide similar conclusions across different shapes and centers of prior distributions. Conducting sensitivity analysis is helpful in examining the influence of prior distributions and specifying reasonable prior distributions for the Bayes factor. A real data example is used to illustrate how to choose reasonable priors by a sensitivity analysis. We hope our results will help researchers choose prior distributions when conducting Bayesian hypothesis testing.

Mechanistic implications of cyclic ADP-ribose hydrolysis and methanolysis catalyzed by calf spleen NAD+glycohydrolase.

The Bayes Factor and Its Implementation in JASP: A Practical Primer

On Bayes factors for hypothesis tests

Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence

Empirical Bayes factors for common hypothesis tests

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

Null hypothesis Bayes factor estimates can be biased in (some) common factorial designs: A simulation study

Bayesian Hypothesis Tests Using Nonparametric Statistics

What is a Bayes factor?

An Objective and Robust Bayes Factor for the Hypothesis Test One Sample and Two Population Means

Bayes factor testing of equality and order constraints on measures of association in social research

The Role of the Bayes Factor in the Evaluation of Evidence

Closed-Form Power and Sample Size Calculations for Bayes Factors

Bayes factor functions for reporting outcomes of hypothesis tests

Nonparametric Bayes Factors Based on Empirical Likelihood Ratios.

Deep Bayes Factors

Bayes Factors Based on Test Statistics and Non-Local Moment Prior Densities

Assessing Bayes Factor Surfaces Using Interactive Visualization and Computer Surrogate Modeling

The expected demise of the Bayes factor

Comparing researchers' degree of dichotomous thinking using frequentist versus Bayesian null hypothesis testing

Bayes Factor in One-Sample Tests of Means with a Sensitivity Analysis: A Discussion of Separate Prior Distributions