Abstract:The evolving landscape of online multiplayer gaming presents unique challenges in assessing the causal impacts of game features. Traditional A/B testing methodologies fall short due to complex player interactions, leading to violations of fundamental assumptions like the Stable Unit Treatment Value Assumption (SUTVA). Unlike traditional social networks with stable and long-term connections, networks in online games are often dynamic and short-lived. Players are temporarily teamed up for the duration of a game, forming transient networks that dissolve once the game ends. This fleeting nature of interactions presents a new challenge compared with running experiments in a stable social network. This study introduces a novel framework for treatment effect estimation in online gaming environments, considering the dynamic and ephemeral network interference that occurs among players. We propose an innovative estimator tailored for scenarios where a completely randomized experimental design is implemented without explicit knowledge of network structures. Notably, our method facilitates post-hoc interference adjustment on experimental data, significantly reducing the complexities and costs associated with intricate experimental designs and randomization strategies. The proposed framework stands out for its ability to accommodate varying levels of interference, thereby yielding more accurate and robust estimations. Through comprehensive simulations set against a variety of interference scenarios, along with empirical validation using real-world data from a mobile gaming environment, we demonstrate the efficacy of our approach. This study represents a pioneering effort in exploring causal inference in user-randomized experiments impacted by dynamic network effects.

Testing and Estimation of Social Network Dependence with Time to Event Data

A Note on Estimating Network Dependence in a Discrete Choice Model

A Latent Logistic Regression Model with Graph Data

Estimation of Peer Influence Effect in Online Games Using Machine Learning Approaches.

A Note on Testing Conditional Independence for Social Network Analysis

Inferring Geographic Coincidence in Ephemeral Social Networks.

A Bayesian Multifactor Spatio-Temporal Model for Estimating Time-Varying Network Interdependence

Treatment Effect Estimation Amidst Dynamic Network Interference in Online Gaming Experiments

Evaluating methods for estimating influence effects in social networks: a simulation study

Exploiting the Dynamic Mutual Influence for Predicting Social Event Participation

Semiparametric Modeling and Analysis for Longitudinal Network Data

Estimating tie strength in social networks using temporal communication data

Are we still friends: Kernel multivariate survival analysis

Estimating Social Influence Using Latent Space Adjusted Approach in R

Testing For Global Covariate Effects in Dynamic Interaction Event Networks

Neighborhood selection with application to social networks

Contrasting Multiple Social Network Autocorrelations for Binary Outcomes, With Applications To Technology Adoption

Dependence matters: Statistical models to identify the drivers of tie formation in economic networks

Modeling Information Diffusion over Social Networks for Temporal Dynamic Prediction

Modelling temporal networks of human face-to-face contacts with public activity and individual reachability

Exploring the Impact of Dynamic Mutual Influence on Social Event Participation.