Abstract:We consider a brand with a given budget that wants to promote a product over multiple rounds of influencer marketing. In each round, it commissions an influencer to promote the product over a social network, and then observes the subsequent diffusion of the product before adaptively choosing the next influencer to commission. This process terminates when the budget is exhausted. We assume that the diffusion process follows the popular Independent Cascade model. We also consider an online learning setting, where the brand initially does not know the diffusion parameters associated with the model, and has to gradually learn the parameters over time. Unlike in existing models, the rounds in our model are correlated through an intermediary constraint: each user can be commissioned for an unlimited number of times. However, each user will spread influence without commission at most once. Due to this added constraint, the order in which the influencers are chosen can change the influence spread, making obsolete existing analysis techniques that based on the notion of adaptive submodularity. We devise a sample path analysis to prove that a greedy policy that knows the diffusion parameters achieves at least $1-1/e - \epsilon$ times the expected reward of the optimal policy. In the online-learning setting, we are the first to consider a truly adaptive decision making framework, rather than assuming independent epochs, and adaptivity only within epochs. Under mild assumptions, we derive a regret bound for our algorithm. In our numerical experiments, we simulate information diffusions on four Twitter sub-networks, and compare our UCB-based learning algorithms with several baseline adaptive seeding strategies. Our learning algorithm consistently outperforms the baselines and achieves rewards close to the greedy policy that knows the true diffusion parameters.

Learning Cascaded Influence under Partial Monitoring

Anytime User Engagement Prediction in Information Cascades for Arbitrary Observation Periods

Online Influence Maximization under Decreasing Cascade Model

Estimation of Peer Influence Effect in Online Games Using Machine Learning Approaches.

A Learning Automaton-Based Algorithm for Influence Maximization in Social Networks

Provably Efficient Reinforcement Learning for Online Adaptive Influence Maximization

Gaussian Process Bandits for Online Influence Maximization

Factorization Bandits for Online Influence Maximization

Online Influence Maximization with Semi-Bandit Feedback under Corruptions

Online influence maximization in non-stationary Social Networks

Learning Automata Based Approach for Influence Maximization Problem on Social Networks

RA-ICM: A Novel Independent Cascade Model Incorporating User Relationships and Attitudes

A Reversed Node Ranking Approach for Influence Maximization in Social Networks.

Beyond Adaptive Submodularity: Adaptive Influence Maximization with Intermediary Constraints

Network Embedding under Partial Monitoring for Evolving Networks.

Multi-task Learning for Influence Estimation and Maximization

Social Bandit Learning: Strangers Can Help

A Co-Evolutionary Model for Inferring Online Social Network User Behaviors.

Contingency-Aware Influence Maximization: A Reinforcement Learning Approach

Neural Active Learning Meets the Partial Monitoring Framework

On Your Mark, Get Set, Predict! Modeling Continuous-Time Dynamics of Cascades for Information Popularity Prediction