Abstract:Deep reinforcement learning (DRL) has opened up many unprecedented opportunities in revolutionizing the digital marketing field. In this study, we designed a DRL-based personalized targeting strategy in a sequential setting. We show that the strategy is able to address three important challenges of sequential targeting: (1) forward looking (balancing between a firm’s current revenue and future revenues), (2) earning while learning (maximizing profits while continuously learning through exploration-exploitation), and (3) scalability (coping with a high-dimensional state and policy space). We illustrate this through a novel design of a DRL-based artificial intelligence (AI) agent. To better adapt DRL to complex consumer behavior dimensions, we proposed a quantization-based uncertainty learning heuristic for efficient exploration-exploitation. Our policy evaluation results through simulation suggest that the proposed DRL agent generates 26.75% more long-term revenues than can the non-DRL approaches on average and learns 76.92% faster than the second fastest model among all benchmarks. Further, in order to better understand the potential underlying mechanisms, we conducted multiple interpretability analyses to explain the patterns of learned optimal policy at both the individual and population levels. Our findings provide important managerial-relevant and theory-consistent insights. For instance, consecutive price promotions at the beginning can capture price-sensitive consumers’ immediate attention, whereas carefully spaced nonpromotional “cooldown” periods between price promotions can allow consumers to adjust their reference points. Additionally, consideration of future revenues is necessary from a long-term horizon, but weighing the future too much can also dampen revenues. In addition, analyses of heterogeneous treatment effects suggest that the optimal promotion sequence pattern highly varies across the consumer engagement stages. Overall, our study results demonstrate DRL’s potential to optimize these strategies’ combination to maximize long-term revenues. This paper was accepted by Kartik Hosanagar, information systems. Supplemental Material: The data files and online appendix are available at https://doi.org/10.1287/mnsc.2022.4621 .

Deep Reinforcement Learning-Driven Smart and Dynamic Mass Personalization

Constructing autonomous, personalized, and private working management of smart home products based on deep reinforcement learning

Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning

Self-Attention Mechanism Enhanced User Interests Modeling for Personalized Recommendation Services in Cyber-Physical-Social Systems.

A Method of Personalized Driving Decision for Smart Car Based on Deep Reinforcement Learning

A Reinforcement Learning Approach to Personalized Learning Recommendation Systems

Personalized Reinforcement Learning with a Budget of Policies

A Deep Reinforcement Learning Real-Time Recommendation Model Based on Long and Short-Term Preference

Interactive Narrative Personalization with Deep Reinforcement Learning

Deep Reinforcement Learning for Sequential Targeting

RLPS: A Reinforcement Learning–Based Framework for Personalized Search

Personalized next-best action recommendation with multi-party interaction learning for automated decision-making

Reinforcement learning for game personalization on edge devices

User-Guided Personalized Image Aesthetic Assessment based on Deep Reinforcement Learning

Pseudo Dyna-Q

Interpretable Personalization via Policy Learning with Linear Decision Boundaries

A Reinforcement Learning Approach for Personalized Diversity in Feeds Recommendation.

DRprofiling: Deep Reinforcement User Profiling for Recommendations in Heterogenous Information Networks

Personalized Lane Change Decision Algorithm Using Deep Reinforcement Learning Approach.

Automatic Music Playlist Generation via Simulation-based Reinforcement Learning

Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation.