Abstract:Due to some widely known critiques of traditional hypothesis testing, Bayesian hypothesis testing using the Bayes factor has been considered as a better alternative. Previous research about the influence of the prior focuses on the prior for the effect size and there is a debate about how to specify the prior. Thus, the focus of this paper is to explore the impact of different priors on the population mean and variance separately (separate priors) on the Bayes factor, and compare the separate priors with the priors on the effect size. Our simulation results show that both the prior distributions on mean and variance have a considerable influence on the Bayes factor, and different types of priors (different separate priors and priors on the effect size) have different influence patterns. We also find that regardless of separate priors or priors on the effect size, and shapes and centers of the priors, different priors could yield similar Bayes factors. Because noninformative prior distributions bias the Bayes factor in support of the null hypothesis, and very informative priors could be risky, we suggest that researchers use weakly informative priors as reasonable priors and they are expected to provide similar conclusions across different shapes and centers of prior distributions. Conducting sensitivity analysis is helpful in examining the influence of prior distributions and specifying reasonable prior distributions for the Bayes factor. A real data example is used to illustrate how to choose reasonable priors by a sensitivity analysis. We hope our results will help researchers choose prior distributions when conducting Bayesian hypothesis testing.

Bayes factor functions for reporting outcomes of hypothesis tests

On Bayes factors for hypothesis tests

Bayes Factors Based on Test Statistics and Non-Local Moment Prior Densities

Nonparametric Bayes Factors Based on Empirical Likelihood Ratios.

Empirical Bayes factors for common hypothesis tests

What is a Bayes factor?

Bayesian Hypothesis Tests Using Nonparametric Statistics

The flaw of averages: Bayes factors as posterior means of the likelihood ratio

A Good check on the Bayes factor

Using Bayes to get the most out of non-significant results

An Objective and Robust Bayes Factor for the Hypothesis Test One Sample and Two Population Means

Testing Informative Hypotheses in Factor Analysis Models Using Bayes Factors.

A tutorial on testing hypotheses using the Bayes factor.

Fiducialize statistical significance: transforming p-values into conservative posterior probabilities and Bayes factors

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

Approximated adjusted fractional Bayes factors: A general method for testing informative hypotheses.

Bayes Factor in One-Sample Tests of Means with a Sensitivity Analysis: A Discussion of Separate Prior Distributions

Closed-Form Power and Sample Size Calculations for Bayes Factors

BFpack: Flexible Bayes Factor Testing of Scientific Theories in R.

On the Null Distribution of Bayes Factors in Linear Regression

Distribution of Bayes' factor