Abstract:Deep reinforcement learning (DRL) has opened up many unprecedented opportunities in revolutionizing the digital marketing field. In this study, we designed a DRL-based personalized targeting strategy in a sequential setting. We show that the strategy is able to address three important challenges of sequential targeting: (1) forward looking (balancing between a firm’s current revenue and future revenues), (2) earning while learning (maximizing profits while continuously learning through exploration-exploitation), and (3) scalability (coping with a high-dimensional state and policy space). We illustrate this through a novel design of a DRL-based artificial intelligence (AI) agent. To better adapt DRL to complex consumer behavior dimensions, we proposed a quantization-based uncertainty learning heuristic for efficient exploration-exploitation. Our policy evaluation results through simulation suggest that the proposed DRL agent generates 26.75% more long-term revenues than can the non-DRL approaches on average and learns 76.92% faster than the second fastest model among all benchmarks. Further, in order to better understand the potential underlying mechanisms, we conducted multiple interpretability analyses to explain the patterns of learned optimal policy at both the individual and population levels. Our findings provide important managerial-relevant and theory-consistent insights. For instance, consecutive price promotions at the beginning can capture price-sensitive consumers’ immediate attention, whereas carefully spaced nonpromotional “cooldown” periods between price promotions can allow consumers to adjust their reference points. Additionally, consideration of future revenues is necessary from a long-term horizon, but weighing the future too much can also dampen revenues. In addition, analyses of heterogeneous treatment effects suggest that the optimal promotion sequence pattern highly varies across the consumer engagement stages. Overall, our study results demonstrate DRL’s potential to optimize these strategies’ combination to maximize long-term revenues. This paper was accepted by Kartik Hosanagar, information systems. Supplemental Material: The data files and online appendix are available at https://doi.org/10.1287/mnsc.2022.4621 .

Deep Reinforcement Learning for Sequential Targeting

AI Agents for Sequential Promotions: Combining Deep Reinforcement Learning and Dynamic Field Experimentation

BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion

An Extremely Data-efficient and Generative LLM-based Reinforcement Learning Agent for Recommenders

Fine-Grained Session Recommendations in E-commerce using Deep Reinforcement Learning

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Dynamic Pricing on E-commerce Platform with Deep Reinforcement Learning: A Field Experiment

DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems

Techniques Toward Optimizing Viewability in RTB Ad Campaigns Using Reinforcement Learning

Intrinsically Motivated Reinforcement Learning Based Recommendation with Counterfactual Data Augmentation

Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systems

DRDT: Dynamic Reflection with Divergent Thinking for LLM-based Sequential Recommendation

Deep reinforcement learning for demand fulfillment in online retail

Robust Reinforcement Learning Objectives for Sequential Recommender Systems

MODRL-TA:A Multi-Objective Deep Reinforcement Learning Framework for Traffic Allocation in E-Commerce Search

Deep reinforcement learning for personalized treatment recommendation

Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data

Dynamic Retail Pricing via Q-Learning -- A Reinforcement Learning Framework for Enhanced Revenue Management

Adaptive trajectory-constrained exploration strategy for deep reinforcement learning

Deep Reinforcement Learning Unleashing the Power of AI in Decision-Making

Sequential Recommendation for Optimizing Both Immediate Feedback and Long-term Retention