Abstract:In the e-commerce era, efficient order fulfillment processes in distribution centers have become a key success factor. One novel technology to streamline these processes is robot-assisted order picking. In these systems, human order pickers are supported by autonomous mobile robots (AMRs), which carry bins for collecting picking orders, autonomously move through the warehouse, and wait in front of a shelf containing a requested stock keeping unit (SKU). Once a picker has approached a waiting AMR and placed the requested SKU into the respective bin, AMR and picker may separate and move toward other picking positions. In this way, pickers continuously move between different waiting AMRs without having to return to the depot. This paper treats the coordination of multiple AMRs and multiple pickers to minimize the makespan. We present a heuristic method for the deterministic case that can handle the requirements of large e-commerce fulfillment centers and successfully solves instances with more than one thousand picking positions. Based on the obtained solutions, the performance of our picking system is compared with the traditional warehouse setup without AMR support and to another work policy using fixed pairings of picker and AMR per order. We find that largely improved makespans can be expected. In addition, we analyze the effects of stochastic picking times, speed differences between AMRs and pickers, and a zoning strategy. The ripple effect caused by stochastic picking times, in which a single delay may cascade through a tightly synchronized schedule and deteriorate picking performance, can be effectively mitigated by separating the workforce into smaller subgroups. Another important finding is that pickers and AMR should have approximately the same travel speed because slower AMRs deteriorate system performance. Finally, zoning slightly decreases the flexibility of the system and should be used if dictated by organizational reasons. History: This article is part of a special issue: Emerging Topics in Transportation Science and Logistics. Supplemental Material: The online appendix is available at https://doi.org/10.1287/trsc.2023.1207 .

Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workers

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Multi-agent Reinforcement Learning for Dynamic Dispatching in Material Handling Systems

Learning Efficient and Fair Policies for Uncertainty-Aware Collaborative Human-Robot Order Picking

The Impact of Overall Optimization on Warehouse Automation

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

The Multi-Agent Pickup and Delivery Problem: MAPF, MARL and Its Warehouse Applications

Deep hierarchical reinforcement learning for collaborative object transportation by heterogeneous agents

Robotic warehousing operations: a learn-then-optimize approach to large-scale neighborhood search

Genetic Scheduling and Reinforcement Learning in Multirobot Systems for Intelligent Warehouses

DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments

Learning Multi-agent Multi-machine Tending by Mobile Robots

Human-Robot Cooperation: Coordinating Autonomous Mobile Robots and Human Order Pickers

Scalable Hierarchical Reinforcement Learning for Hyper Scale Multi-Robot Task Planning

Deep Reinforcement Learning for Dynamic Order Picking in Warehouse Operations

Multi-Robot Coordination and Layout Design for Automated Warehousing

RTAW: An Attention Inspired Reinforcement Learning Method for Multi-Robot Task Allocation in Warehouse Environments

Cooperative Multi-Agent Reinforcement Learning for Inventory Management

Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell

Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance

The reinforcement learning-based multi-agent cooperative approach for the adaptive speed regulation on a metallurgical pickling line