Abstract:Revenue management (RM) is essential for a wide range of industries such as airlines, hotels, cruise lines, fashion, and seasonal retail. This paper focuses on the multi-perishable-product dynamic pricing (MPPDP) problem, a significant research field in RM, where a company sells multiple interactive and perishable products over a limited selling window without replenishment. Most studies in this field assume customer behavior, which is modeled by demand function, is known in advance. Even when considering uncertainty in customer behavior, most studies still assume the mathematical form or structural properties of the underlying demand function are known in advance. However, these assumptions are usually inconsistent with the actual market situation. Recently, Reinforcement Learning (RL), a potent technique for handling sequential decision-making problems, has been increasingly applied to solve complex dynamic pricing problems without relying on any assumption about demand functions. However, the curse of dimensionality poses a challenge for currently used centralized RL algorithms when solving the MPPDP problem due to the exponential expansion of the joint price space with the number of products. To address this issue, our paper proposes a distributed dynamic pricing framework and innovatively models the MPPDP problem as a Fully Cooperative Markov Game solved by Multi-Agent Reinforcement Learning (MARL). Additionally, we use counterfactual baselines to design appropriate agent-specific reward signals that facilitate faster learning for the agents in our established multi-agent cooperative system. Finally, two MARL-based distributed dynamic pricing algorithms, Counterfactual Q-learning, and Counterfactual DQN, are proposed for the MPPDP problem. Through the case studies on four computer-simulated markets, we show that our algorithms can alleviate the curse of dimensionality faced by centralized RL algorithms, expedite the learning process, and demonstrate satisfactory performance without relying on any assumption about demand functions. In conclusion, our work provides an effective MARL-based distributed dynamic pricing framework and algorithms for companies to efficiently price their multiple perishable products in modern highly uncertain markets.

Dynamic Pricing Model for E-Commerce Products Based on DDQN

Dynamic Pricing on E-commerce Platform with Deep Reinforcement Learning: A Field Experiment

Online Learning and Pricing for Multiple Products with Reference Price Effects

Distributed Dynamic Pricing Strategy Based on Deep Reinforcement Learning Approach in a Presale Mechanism

Dynamic Pricing Strategies for Perishable Product in a Competitive Multi-Agent Retailers Market.

Dynamic Pricing by Multiagent Reinforcement Learning

Dynamic pricing of electronic products with consumer reviews

A Dynamic Pricing Method In E-Commerce Based On Pso-Trained Neural Network

Dynamic Pricing and Joint Promotion Strategy for an Online Retailer

Dynamic Pricing Scheme for Edge Computing Services: A Two-layer Reinforcement Learning Approach

Research on dynamic pricing based on auction in e-commerce

Dynamic Pricing with Parametric Demand Learning and Reference-Price Effects

Deep Reinforcement Learning-Based Pricing Strategy in Double-Auction Market for Edge Computing Resource Allocation

Enhancing Sparse Data Performance in E-Commerce Dynamic Pricing with Reinforcement Learning and Pre-Trained Learning

Evaluating Differential Pricing in E-Commerce from the Perspective of Utility

Distributed Dynamic Pricing of Multiple Perishable Products Using Multi-Agent Reinforcement Learning.

A deep Q-learning approach to optimize ordering and dynamic pricing decisions in the presence of strategic customers

Dynamic pricing model of digital knowledge commodity considering competition from congener commodity

E-Commerce Game Model - Balancing Platform Service Charges with Vendor Profitability.

Dynamic Vs. Static Pricing in A Supply Chain with Advertising

Dynamic Pricing and Sales Effort in Dual-Channel Retailing for Seasonal Products