Abstract:Researchers are more likely to share notable findings. As a result, published findings tend to overstate the magnitude of real-world phenomena. This bias is a natural concern for asset pricing research, which has found hundreds of return predictors and little consensus on their origins. Empirical evidence on publication bias comes from large scale meta-studies. Meta-studies of cross-sectional return predictability have settled on four stylized facts that demonstrate publication bias is not a dominant factor: (1) almost all findings can be replicated, (2) predictability persists out-of-sample, (3) empirical $t$-statistics are much larger than 2.0, and (4) predictors are weakly correlated. Each of these facts has been demonstrated in at least three meta-studies. Empirical Bayes statistics turn these facts into publication bias corrections. Estimates from three meta-studies find that the average correction (shrinkage) accounts for only 10 to 15 percent of in-sample mean returns and that the risk of inference going in the wrong direction (the false discovery rate) is less than 10%. Meta-studies also find that $t$-statistic hurdles exceed 3.0 in multiple testing algorithms and that returns are 30 to 50 percent weaker in alternative portfolio tests. These facts are easily misinterpreted as evidence of publication bias effects. We clarify these misinterpretations and others, including the conflating of ``mostly false findings'' with ``many insignificant findings,'' ``data snooping'' with ``liquidity effects,'' and ``failed replications'' with ``insignificant ad-hoc trading strategies.'' Meta-studies outside of the cross-sectional literature are rare. The four facts from cross-sectional meta-studies provide a framework for future research. We illustrate with a preliminary re-examination of equity premium predictability.

Common pricing across asset classes: Empirical evidence revisited

Are there common factors in individual commodity futures returns?

A Factor Portfolio Asset Pricing Model Based on the Optimal Distribution of Risk and Return

The Pricing of Volatility Risk Across Asset Classes and the Fama and French Three Factor Model

Empirical Asset Pricing with Many Test Assets

Intermediary Asset Pricing: New Evidence from Many Asset Classes

Data-generating process and time-series asset pricing

On the importance of asset pricing factors in the relative valuation

Anomaly or Risk Factor? A Stepwise Evaluation

Characteristics-Based Factors

Factors That Fit the Time Series and Cross-Section of Stock Returns

Combining factors

A common risk factor in global credit and equity markets: An exploratory analysis of the subprime and the sovereign-debt crises

Q‐FACTORS IN EMPIRICAL ASSET PRICING: A REVIEW AND SYNTHESIS

Product network and origin of common equity factor risks

A two-Factor Asset Pricing Model and the Fat Tail Distribution of Firm Sizes

Cross-section without factors: a string model for expected returns

Publication Bias in Asset Pricing Research

Lucky factors

Pricing the Global Industry Portfolios

Common Risk Factors Versus a Mispricing Factor of Tokyo Stock Exchange Firms: Inquiries into the Fundamental Value Derived from Analyst Earnings Forecasts