Neural Optimization with Adaptive Heuristics for Intelligent Marketing System

Changshuai Wei,Benjamin Zelditch,Joyce Chen,Andre Assuncao Silva T Ribeiro,Jingyi Kenneth Tay,Borja Ocejo Elizondo,Keerthi Selvaraj,Aman Gupta,Licurgo Benemann De Almeida

DOI: https://doi.org/10.1145/3637528.3671591

2024-06-26

Abstract:Computational marketing has become increasingly important in today's digital world, facing challenges such as massive heterogeneous data, multi-channel customer journeys, and limited marketing budgets. In this paper, we propose a general framework for marketing AI systems, the Neural Optimization with Adaptive Heuristics (NOAH) framework. NOAH is the first general framework for marketing optimization that considers both to-business (2B) and to-consumer (2C) products, as well as both owned and paid channels. We describe key modules of the NOAH framework, including prediction, optimization, and adaptive heuristics, providing examples for bidding and content optimization. We then detail the successful application of NOAH to LinkedIn's email marketing system, showcasing significant wins over the legacy ranking system. Additionally, we share details and insights that are broadly useful, particularly on: (i) addressing delayed feedback with lifetime value, (ii) performing large-scale linear programming with randomization, (iii) improving retrieval with audience expansion, (iv) reducing signal dilution in targeting tests, and (v) handling zero-inflated heavy-tail metrics in statistical testing.

Methodology,Artificial Intelligence,Information Retrieval,Machine Learning,Optimization and Control

What problem does this paper attempt to address?

The paper aims to address some key challenges in the field of digital marketing, particularly the complexity and diversity issues faced by online marketing systems. Specifically, the research proposes a general framework—Neural Optimization and Adaptive Heuristics (NOAH) framework for intelligent marketing systems.

### Problems the Paper Attempts to Solve:

1. **Diversity and Scale of Data**: Marketing data comes from various channels, and these data differ significantly in granularity, type, etc. For example, user-level feedback data can be obtained from email channels, while only aggregated information can be collected from paid channels like search engines.

2. **Complexity of Goal Definition**: For different products (consumer-facing or business-facing), their marketing lifecycles differ, leading to machine learning models needing to handle issues like delayed feedback.

3. **Complexity of Action Space**: Marketing decisions include the timing, frequency, content selection of marketing messages, target audience positioning, and bidding for campaigns on different advertising platforms. A unified optimization framework is needed to improve marketing efficiency.

4. **Various Constraints**: Marketing activities are influenced by cost limitations and other operational constraints, such as user complaints or unsubscribe behaviors, and minimum volume requirements for different types of products.

### Key Components of the NOAH Framework:

- **Prediction Module**: Predicts business metrics for given marketing actions, such as click-through rate, conversion rate, etc.

- **Optimization Module**: Selects the optimal marketing actions based on prediction results while considering various business constraints, using methods like linear programming for optimization.

- **Adaptive Heuristics Module**: Connects different parts of the system to form a feedback loop, ensuring stable operation and consistency of the system.

### Practical Application Case:

The paper details the successful application of the NOAH framework in LinkedIn's email marketing system, including the design and implementation of key modules and the significant results obtained through actual A/B testing. Additionally, the paper shares some important innovations and practical experiences, such as handling delayed feedback issues and strategies for implementing large-scale linear programming.

In summary, the paper proposes a general intelligent marketing framework and validates its effectiveness and practicality through real-world cases, providing new ideas and technical support for future marketing optimization.