Abstract:Purpose: We review statistical methods for assessing the possible impact of bias due to unmeasured confounding in real world data analysis and provide detailed recommendations for choosing among the methods. Methods: By updating an earlier systematic review, we summarize modern statistical best practices for evaluating and correcting for potential bias due to unmeasured confounding in estimating causal treatment effect from non-interventional studies. Results: We suggest a hierarchical structure for assessing unmeasured confounding. First, for initial sensitivity analyses, we strongly recommend applying a recently developed method, the E-value, that is straightforward to apply and does not require prior knowledge or assumptions about the unmeasured confounder(s). When some such knowledge is available, the E-value could be supplemented by the rule-out or array method at this step. If these initial analyses suggest results may not be robust to unmeasured confounding, subsequent analyses could be conducted using more specialized statistical methods, which we categorize based on whether they require access to external data on the suspected unmeasured confounder(s), internal data, or no data. Other factors for choosing the subsequent sensitivity analysis methods are also introduced and discussed, including the types of unmeasured confounders and whether the subsequent sensitivity analysis is intended to provide a corrected causal treatment effect. Conclusion: Various analytical methods have been proposed to address unmeasured confounding, but little research has discussed a structured approach to select appropriate methods in practice. In providing practical suggestions for choosing appropriate initial and, potentially, more specialized subsequent sensitivity analyses, we hope to facilitate the widespread reporting of such sensitivity analyses in non-interventional studies. The suggested approach also has the potential to inform pre-specification of sensitivity analyses before executing the analysis, and therefore increase the transparency and limit selective study reporting.

Sensitivity Analysis for Unmeasured Confounding in the Estimation of Marginal Causal Effects

Sensitivity Analysis Without Assumptions

Flexible sensitivity analysis for causal inference in observational studies subject to unmeasured confounding

Sensitivity Analysis via the Proportion of Unmeasured Confounding

[Sensitivity analysis method for unmeasured confounding interference in observational study]

Bayesian sensitivity analysis for unmeasured confounding in causal mediation analysis

A Risk-Ratio-Based Marginal Sensitivity Model for Causal Effects in Observational Studies

A flexible sensitivity analysis approach for unmeasured confounding with multiple treatments and a binary outcome with application to SEER-Medicare lung cancer data

Sensitivity analysis for the generalization of experimental results

Assessing the impact of unmeasured confounders for credible and reliable real-world evidence

A note on a sensitivity analysis for unmeasured confounding, and the related E-value

Real Effect or Bias? Good Practices for Evaluating the Robustness of Evidence From Comparative Observational Studies Through Quantitative Sensitivity Analysis for Unmeasured Confounding

Sensitivity analysis for causal decomposition analysis: Assessing robustness toward omitted variable bias

Sensitivity analysis of unmeasured confounding in causal inference based on exponential tilting and super learner

Sensitivity Analysis of Treatment Effect to Unmeasured Confounding in Observational Studies with Survival and Competing Risks Outcomes

Making sense of sensitivity: extending omitted variable bias

On sensitivity value of pair-matched observational studies

A simple sensitivity analysis method for unmeasured confounders via linear programming with estimating equation constraints

Doubly-Valid/Doubly-Sharp Sensitivity Analysis for Causal Inference with Unmeasured Confounding

Assessing the Unobserved: Enhancing Causal Inference in Sociology with Sensitivity Analysis

Model-assisted sensitivity analysis for treatment effects under unmeasured confounding via regularized calibrated estimation