Abstract:We apply Multi-Agent Deep Reinforcement Learning (MADRL) to multi-echelon inventory management problems and evaluate MADRL’s performance to minimize the overall costs of a supply chain. We also examine whether the upfront-only information-sharing mechanism used in MADRL helps alleviate the bullwhip effect in a supply chain. We apply Heterogeneous-Agent Proximal Policy Optimization (HAPPO), a MADRL algorithm, to the decentralized multi-echelon inventory management problems in both a serial supply chain and a supply chain network. Our results show that policies constructed by HAPPO achieve lower overall costs than policies constructed by single-agent deep reinforcement learning and other heuristic policies. Also, the application of HAPPO results in a less significant bullwhip effect than policies constructed by single-agent deep reinforcement learning where information is not shared among actors. Somewhat surprisingly, compared to using the overall costs of the system as a minimization target for each actor, HAPPO achieves lower overall costs when the minimization target for each actor is a combination of its own costs and the overall costs of the system. Our results provide a new perspective on the benefit of information sharing inside the supply chain that helps alleviate the bullwhip effect and improve the overall performance of the system. Upfront information sharing and action coordination in model training among actors is essential, with the former more essential, for improving a supply chain’s overall performance when applying MADRL. Neither actors being fully self-interested nor actors being fully system-focused leads to the best practical performance of policies learned and constructed by MADRL. Our results also verify MADRL’s potential in solving various multi-echelon inventory management problems with complex supply chain structures and in non-stationary market environments.

A Multi-Agent Coordination of a Supply Chain Ordering Management with Multiple Members Using Reinforcement Learning

Application of Multi-Agent Reinforcement Learning to Supply Chain Ordering Management

Analyses About Efficiency Of Reinforcement Learning To Supply Chain Ordering Management

Coordination of Supply Chains involving Various Agents with Behavioral Preferences

SCM network with multi-agent reinforcement learning

Solution Model for the Bullwhip Effect in Supply Chain Based on Reinforcement Learning

Deep Reinforcement Learning Approach for Capacitated Supply Chain optimization under Demand Uncertainty

Case-based reinforcement learning for dynamic inventory control in a multi-agent supply-chain system

Multi-Agent Deep Reinforcement Learning for Multi-Echelon Inventory Management

The Improvement on Reinforcement Learning for SCM by the Agent Policy Mapping

Policy Transition of Reinforcement Learning for an Agent Based SCM System

A Model for Refining the Distributed SCP Plans Based on Coordinated RL

Leveraging reinforcement learning and evolutionary strategies for dynamic multi objective decision making in supply chain management

Agent based modelling for continuously varying supply chains

Solving Inventory Management Problems Through Deep Reinforcement Learning

Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chains

Multi-echelon Supply Chains with Uncertain Seasonal Demands and Lead Times Using Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Inventory Control under Stochastic Lead Time and Demand

Reinforcement Learning Provides a Flexible Approach for Realistic Supply Chain Safety Stock Optimisation

A Multi-Agent Reinforcement Learning Method With Route Recorders for Vehicle Routing in Supply Chain Management

TheImprovement on Reinforcement Learning Forscm Bytheagentpolicy Mapping