Abstract:Can instrumental variables be found from data? While instrumental variable (IV) methods are widely used to identify causal effect, testing their validity from observed data remains a challenge. This is because validity of an IV depends on two assumptions, exclusion and as-if-random, that are largely believed to be untestable from data. In this paper, we show that under certain conditions, testing for instrumental variables is possible. We build upon prior work on necessary tests to derive a test that characterizes the odds of being a valid instrument, thus yielding the name "necessary and probably sufficient". The test works by defining the class of invalid-IV and valid-IV causal models as Bayesian generative models and comparing their marginal likelihood based on observed data. When all variables are discrete, we also provide a method to efficiently compute these marginal likelihoods. We evaluate the test on an extensive set of simulations for binary data, inspired by an open problem for IV testing proposed in past work. We find that the test is most powerful when an instrument follows monotonicity---effect on treatment is either non-decreasing or non-increasing---and has moderate-to-weak strength; incidentally, such instruments are commonly used in observational studies. Among as-if-random and exclusion, it detects exclusion violations with higher power. Applying the test to IVs from two seminal studies on instrumental variables and five recent studies from the American Economic Review shows that many of the instruments may be flawed, at least when all variables are discretized. The proposed test opens the possibility of data-driven validation and search for instrumental variables.

Resistant Inference in Instrumental Variable Models

An Omitted Variable Bias Framework for Sensitivity Analysis of Instrumental Variables

An Identification and Dimensionality Robust Test for Instrumental Variables Models

The Validity of Instruments Revisited

Weak-instrument-robust subvector inference in instrumental variables regression: A subvector Lagrange multiplier test and properties of subvector Anderson-Rubin confidence sets

Conditional Likelihood Ratio Test with Many Weak Instruments

Testability of Instrumental Variables in Additive Nonlinear, Non-Constant Effects Models

Instrumental variables: A non-asymptotic viewpoint

Necessary and Probably Sufficient Test for Finding Valid Instrumental Variables

Testing for homogeneous treatment effects in linear and nonparametric instrumental variable models

Two Robust Tools for Inference about Causal Effects with Invalid Instruments

Weak-Instrument Robust Tests in Two-Sample Summary-Data Mendelian Randomization

Robust causal inference with continuous instruments using the local instrumental variable curve

Weak identification with many instruments

A weak instrument [Formula: see text]-test in linear IV models with multiple endogenous variables

Sensitivity Analysis of G-estimators to Invalid Instrumental Variables

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

The Instrumental Variable Model with Categorical Instrument, Treatment and Outcome: Characterization, Partial Identification, and Statistical Inference

A Ridge-Regularized Jackknifed Anderson-Rubin Test

A Practical Guide to Weak Instruments

Instrument strength in IV estimation and inference: A guide to theory and practice