Abstract:Deep reinforcement learning (DRL) has opened up many unprecedented opportunities in revolutionizing the digital marketing field. In this study, we designed a DRL-based personalized targeting strategy in a sequential setting. We show that the strategy is able to address three important challenges of sequential targeting: (1) forward looking (balancing between a firm’s current revenue and future revenues), (2) earning while learning (maximizing profits while continuously learning through exploration-exploitation), and (3) scalability (coping with a high-dimensional state and policy space). We illustrate this through a novel design of a DRL-based artificial intelligence (AI) agent. To better adapt DRL to complex consumer behavior dimensions, we proposed a quantization-based uncertainty learning heuristic for efficient exploration-exploitation. Our policy evaluation results through simulation suggest that the proposed DRL agent generates 26.75% more long-term revenues than can the non-DRL approaches on average and learns 76.92% faster than the second fastest model among all benchmarks. Further, in order to better understand the potential underlying mechanisms, we conducted multiple interpretability analyses to explain the patterns of learned optimal policy at both the individual and population levels. Our findings provide important managerial-relevant and theory-consistent insights. For instance, consecutive price promotions at the beginning can capture price-sensitive consumers’ immediate attention, whereas carefully spaced nonpromotional “cooldown” periods between price promotions can allow consumers to adjust their reference points. Additionally, consideration of future revenues is necessary from a long-term horizon, but weighing the future too much can also dampen revenues. In addition, analyses of heterogeneous treatment effects suggest that the optimal promotion sequence pattern highly varies across the consumer engagement stages. Overall, our study results demonstrate DRL’s potential to optimize these strategies’ combination to maximize long-term revenues. This paper was accepted by Kartik Hosanagar, information systems. Supplemental Material: The data files and online appendix are available at https://doi.org/10.1287/mnsc.2022.4621 .

AI Agents for Sequential Promotions: Combining Deep Reinforcement Learning and Dynamic Field Experimentation

Deep Reinforcement Learning for Sequential Targeting

Personalized Mobile Targeting with User Engagement Stages: Combining a Structural Hidden Markov Model and Field Experiment

A Deep Reinforcement Learning Approach to Proactive Content Pushing and Recommendation for Mobile Users.

Modeling User Engagement in Mobile Content Consumption with Tapstream Data.

Personalized Promotion Decision Making Based on Direct and Enduring Effect Predictions

An Extremely Data-efficient and Generative LLM-based Reinforcement Learning Agent for Recommenders

BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion

Simulation-Based Benchmarking of Reinforcement Learning Agents for Personalized Retail Promotions

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Dynamic Pricing on E-commerce Platform with Deep Reinforcement Learning: A Field Experiment

Sequential Advertising Agent with Interpretable User Hidden Intents

Deep Learning-Based Prediction and Revenue Optimization for Online Platform User Journeys

Deep Reinforcement Learning-Driven Smart and Dynamic Mass Personalization

DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems

Dynamic Optimization of Portfolio Allocation Using Deep Reinforcement Learning

Capturing Conversion Rate Fluctuation during Sales Promotions: A Novel Historical Data Reuse Approach

Should I send this notification? Optimizing push notifications decision making by modeling the future

Multi-Scenario Combination Based on Multi-Agent Reinforcement Learning to Optimize the Advertising Recommendation System

Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning

Cross-contextual Sequential Optimization Via Deep Reinforcement Learning for Algorithmic Trading