Abstract:Influence Maximization (IM) is a classical combinatorial optimization problem, which can be widely used in mobile networks, social computing, and recommendation systems. It aims at selecting a small number of users such that maximizing the influence spread across the online social network. Because of its potential commercial and academic value, there are a lot of researchers focusing on studying the IM problem from different perspectives. The main challenge comes from the NP-hardness of the IM problem and #P-hardness of estimating the influence spread, thus traditional algorithms for overcoming them can be categorized into two classes: heuristic algorithms and approximation algorithms. However, there is no theoretical guarantee for heuristic algorithms, and the theoretical design is close to the limit. Therefore, it is almost impossible to further optimize and improve their performance. With the rapid development of artificial intelligence, technologies based on Machine Learning (ML) have achieved remarkable achievements in many fields. In view of this, in recent years, a number of new methods have emerged to solve combinatorial optimization problems by using ML-based techniques. These methods have the advantages of fast solving speed and strong generalization ability to unknown graphs, which provide a brand-new direction for solving combinatorial optimization problems. Therefore, we abandon the traditional algorithms based on iterative search and review the recent development of ML-based methods, especially Deep Reinforcement Learning, to solve the IM problem and other variants in social networks. We focus on summarizing the relevant background knowledge, basic principles, common methods, and applied research. Finally, the challenges that need to be solved urgently in future IM research are pointed out.

Combinatorial Online Learning Based on Optimizing Feedbacks

Learning-augmented Algorithms for Online Subset Sum

Online Influence Maximization: Concept and Algorithm

Inverse Multiobjective Optimization Through Online Learning

Community Exploration: from Offline Optimization to Online Learning

A Survey on Influence Maximization: From an ML-Based Combinatorial Optimization

Combinatorial Bandits with Relative Feedback

Community Exploration: From Offline Optimization to Online Learning.

Federated Combinatorial Multi-Agent Multi-Armed Bandits

Learning for Robust Combinatorial Optimization: Algorithm and Application

Combinatorial Pure Exploration with Full-bandit Feedback and Beyond: Solving Combinatorial Optimization under Uncertainty with Limited Observation

Understanding Curriculum Learning in Policy Optimization for Online Combinatorial Optimization

Online learning: A comprehensive survey

Online Multiclass Learning With "Bandit" Feedback Under A Confidence-Weighted Approach

Non-stationary Continuum-armed Bandits for Online Hyperparameter Optimization.

Online Stochastic Linear Optimization under One-bit Feedback

Non-stationary Dueling Bandits for Online Learning to Rank

Efficient Methods for Non-stationary Online Learning

Stochastic Online Greedy Learning with Semi-Bandit Feedbacks

Dynamic Assortment with Online Learning under Threshold Multinomial Logit Model

Jointly Learning to Recommend and Advertise