Abstract:The authors discuss the cumulative evidence index (CEI), a Bayesian metric that quantifies both the consistency and convergence of evidence across different types of studies, emphasizing the greater epistemological weight typically attributed to convergence. The CEI addresses the reproducibility crisis by showing how convergent evidence across multiple study types can advance scientific consensus, even when individual studies fail to yield reproducible results. The reproducibility crisis highlights several unresolved issues in science, including the need to develop measures that gauge both the consistency and convergence of data sets. While existing meta‐analytic methods quantify the consistency of evidence, they do not quantify its convergence: the extent to which different types of empirical methods have provided evidence to support a hypothesis. To address this gap in meta‐analysis, we and colleagues developed a summary metric—the cumulative evidence index (CEI)—which uses Bayesian statistics to quantify the degree of both consistency and convergence of evidence regarding causal hypotheses between two phenomena. Here, we outline the CEI's underlying model, which quantifies the extent to which studies of four types—positive intervention, negative intervention, positive non‐intervention and negative non‐intervention—lend credence to any of three types of causal relations: excitatory, inhibitory or no‐connection. Along with p‐values and other measures, the CEI can provide a more holistic perspective on a set of evidence by quantitatively expressing epistemic principles that scientists regularly employ qualitatively. The CEI can thus address the reproducibility crisis by formally demonstrating how convergent evidence across multiple study types can yield progress toward scientific consensus, even when an individual type of study fails to yield reproducible results.

Consensus meetings will outperform integrative experiments

Improving the consensus performance via predictive mechanisms

Fostering Consensus in Multidimensional Continuous Opinion Dynamics under Bounded Confidence

Integrative experiments require a shared theoretical and methodological basis

Experiment commensurability does not necessitate research consolidation

Emergence Mechanisms of Group Consensus in Social Networks

Quantifying convergence and consistency

How does active participation effect consensus: Adaptive network model of opinion dynamics and influence maximizing rewiring

Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power

The Dynamics of Consensus Building in Intracultural and Intercultural Negotiations

An approach for reaching consensus in large-scale group decision-making focusing on dimension reduction

A survey of the monotonicity and non-contradiction of consensus methods and supertree methods

Individual differences do matter

BRAINSTORMING: Consensus Learning in Practice

Many-option collective decision making: discrete collective estimation in large decision spaces

Integrating Incomplete Preference Estimation and Consistency Control in Consensus Reaching

Social and strategic imitation: the way to consensus

Interdisciplinary collaboration from diverse science teams can produce significant outcomes

The functional aspects of selective exposure for collective decision-making under social influence

Consensus reaching with minimum adjustment and consistency management in group decision making with intuitionistic multiplicative preference relations

Cognitive Diversity and Consensus in Group Decision Making: The Role of Inputs, Processes, and Outcomes.