Abstract:Effect modification means the magnitude or stability of a treatment effect varies as a function of an observed covariate. Generally, larger and more stable treatment effects are insensitive to larger biases from unmeasured covariates, so a causal conclusion may be considerably firmer if this pattern is noted if it occurs. We propose a new strategy, called the submax-method, that combines exploratory and confirmatory efforts to determine whether there is stronger evidence of causality - that is, greater insensitivity to unmeasured confounding - in some subgroups of individuals. It uses the joint distribution of test statistics that split the data in various ways based on certain observed covariates. For $L$ binary covariates, the method splits the population $L$ times into two subpopulations, perhaps first men and women, perhaps then smokers and nonsmokers, computing a test statistic from each subpopulation, and appends the test statistic for the whole population, making $2L+1$ test statistics in total. Although $L$ binary covariates define $2^{L}$ interaction groups, only $2L+1$ tests are performed, and at least $L+1$ of these tests use at least half of the data. The submax-method achieves the highest design sensitivity and the highest Bahadur efficiency of its component tests. Moreover, the form of the test is sufficiently tractable that its large sample power may be studied analytically. The simulation suggests that the submax method exhibits superior performance, in comparison with an approach using CART, when there is effect modification of moderate size. Using data from the NHANES I Epidemiologic Follow-Up Survey, an observational study of the effects of physical activity on survival is used to illustrate the method. The method is implemented in the $\texttt{R}$ package $\texttt{submax}$ which contains the NHANES example.

A Marginal Effects Approach to Interpreting Main Effects and Moderation

Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions

Interpreting moderated multiple regression: A comment on Van Iddekinge, Aguinis, Mackey, and DeOrtentiis (2018).

Regression-with-residuals Estimation of Marginal Effects: A Method of Adjusting for Treatment-induced Confounders that may also be Moderators

Improving Our Understanding of Moderation and Mediation in Strategic Management Research

A Note on Evaluating the Moderated Mediation Effect

How to define and test an indirect moderation model: The missing link in regression-based path models

Moderated Mediation Analysis Using Bayesian Methods

Testing Moderation in Business and Psychological Studies with Latent Moderated Structural Equations

Estimating Causal Moderation Effects with Randomized Treatments and Non-Randomized Moderators

Robust Mediation Analysis Based on Median Regression.

Conflating marginal and conditional treatment effects: Comments on 'Assessing the performance of population adjustment methods for anchored indirect comparisons: A simulation study'

Extensions of Auxiliary Variable Approaches for the Investigation of Mediation, Moderation, and Conditional Effects in Mixture Models

Best-Practice Recommendations for Estimating Cross-Level Interaction Effects Using Multilevel Modeling

Evaluating Marginal Policy Changes and the Average Effect of Treatment for Individuals at the Margin

Toward terminological, conceptual, and statistical clarity in the study of mediators and moderators: Examples from the child-clinical and pediatric psychology literatures.

Misleading Heuristics and Moderated Multiple Regression Models

Partial, conditional, and moderated moderated mediation: Quantification, inference, and interpretation

A powerful approach to the study of moderate effect modification in observational studies

The Measurement and Communication of Effect Sizes in Management Research

Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations.