Abstract:In this paper, we introduce a tree-based approach adjusting for observable self-selection bias in intervention studies in management research. In contrast to traditional propensity score (PS) matching methods, including those using classification trees as a subcomponent, our tree-based approach provides a standalone, automated, data-driven methodology that allows for (1) the examination of nascent interventions whose selection is difficult and costly to theoretically specify a priori, (2) detection of heterogeneous intervention effects for different pre-intervention profiles, (3) identification of pre-intervention variables that correlate with the self-selected intervention, and (4) visual presentation of intervention effects that is easy to discern and understand. As such, the tree-based approach is a useful tool for analyzing observational impact studies as well as for post-analysis of experimental data. The tree-based approach is particularly advantageous in the analyses of big data, or data with large sample sizes and a large number of variables. It outperforms PS in terms of computational time, data loss, and automatic capture of nonlinear relationships and heterogeneous interventions. It also requires less user specification and choices than PS, reducing potential data dredging. We discuss the performance of our method in the context of such big data and present results for very large simulated samples with many variables. We illustrate the method and the insights it yields in the context of three impact studies with different study designs: reanalysis of a field study on the effect of training on earnings, analysis of the impact of an electronic governance service in India based on a quasi-experiment, and performance comparison of contract pricing mechanisms and durations in IT outsourcing using observational data.

A Tree-Based Method of Analysis for Prospective Studies.

Modified Poisson Regression Model for Data of Prospective Studies with Common Outcomes

Examples Using Tree-Based Analysis

Tree-Based Analysis

Study on the Application of Classification Tree Model in Screening the Risk Factors of Malignant Tumor

CASE-CONTROL SURVIVAL ANALYSIS WITH A GENERAL SEMIPARAMETRIC SHARED FRAILTY MODEL - A PSEUDO FULL LIKELIHOOD APPROACH

Tree-based, Two-Stage Risk Factor Analysis for Spontaneous Abortion.

Retrospective Versus Prospective Score Tests For Genetic Association With Case-Control Data

Unlocking Retrospective Prevalent Information in EHRs -- a Pairwise Pseudolikelihood Approach

A Tree-Based Approach for Addressing Self-Selection in Impact Studies with Big Data

Look before you leap: systematic evaluation of tree-based statistical methods in subgroup identification.

Risk Projection for Time-to-Event Outcome Leveraging Summary Statistics With Source Individual-Level Data

Prospective and Retrospective Causal Inferences Based on the Potential Outcome Framework

Risk projection for time-to-event outcome from population-based case–control studies leveraging summary statistics from the target population

A Comparative Study of Design-Based and Analysis-Based Approaches to Causal Inference with Observational Data

Analysis of Case-Control Association Studies: SNPs, Imputation and Haplotypes

Estimating Perinatal Critical Windows of Susceptibility to Environmental Mixtures via Structured Bayesian Regression Tree Pairs

A Resampling Approach for Causal Inference on Novel Two-Point Time-Series with Application to Identify Risk Factors for Type-2 Diabetes and Cardiovascular Disease

A framework for understanding selection bias in real-world healthcare data

Tackling Simpson's Paradox in Big Data using Classification & Regression Trees.

Alternative Tree-Structured Survival Analysis Based on Variance of Survival Time