Abstract:Heavy goods vehicles are vital backbones of the supply chain delivery system but also contribute significantly to carbon emissions with only 60% loading efficiency in the United Kingdom. Collaborative vehicle routing has been proposed as a solution to increase efficiency, but challenges remain to make this a possibility. One key challenge is the efficient computation of viable solutions for co-loading and routing. Current operations research methods suffer from non-linear scaling with increasing problem size and are therefore bound to limited geographic areas to compute results in time for day-to-day operations. This only allows for local optima in routing and leaves global optimisation potential untouched. We develop a reinforcement learning model to solve the three-dimensional loading capacitated vehicle routing problem in approximately linear time. While this problem has been studied extensively in operations research, no publications on solving it with reinforcement learning exist. We demonstrate the favourable scaling of our reinforcement learning model and benchmark our routing performance against state-of-the-art methods. The model performs within an average gap of 3.83% to 8.10% compared to established methods. Our model not only represents a promising first step towards large-scale logistics optimisation with reinforcement learning but also lays the foundation for this research stream. GitHub: <a class="link-external link-https" href="https://github.com/if-loops/3L-CVRP" rel="external noopener nofollow">this https URL</a>

Solving Real-World Vehicle Routing Problems With Evolutionary Algorithms

Evolutionary Freight Transportation Planning

Evolutionary Algorithm of Port Based Location Routing Problem

Joint Fleet Sizing and Charging System Planning for Autonomous Electric Vehicles

A Case Study of Vehicle Route Optimization

Research for Integrated Vehicle Scheduling and Filling Problem in Logistics Systems

Adaptive large neighborhood search for vehicle routing problems with transshipment facilities arising in city logistics

A Review of the Evolutionary Algorithm Based VRP Problem

Solving Generalized Vehicle Routing Problem With Occasional Drivers via Evolutionary Multitasking

A combined genetic algorithm and A* search algorithm for the electric vehicle routing problem with time windows

Efficient Path Planning in Large Unknown Environments with Switchable System Models for Automated Vehicles

Adaptive Memory Procedure for Solving Real-world Vehicle Routing Problem

Scalable Deployment of Efficient Transportation Optimization for SMEs and Public Sector

Optimizing electric vehicle routing with nonlinear charging and time windows using improved differential evolution algorithm

Improved ant colony optimization for the vehicle routing problem with split pickup and split delivery

An Effective Evolutionary Algorithm for the Biobjective Full Truckload Transportation Service Procurement Problem

Using Reinforcement Learning for the Three-Dimensional Loading Capacitated Vehicle Routing Problem

Evolving E-commerce Logistics Planning- Integrating Embedded Technology and Ant Colony Algorithm for Enhanced Efficiency

Simulation-based optimization of a complex mail transportation network

Hybrid modeling of collaborative freight transportation planning using agent-based simulation, auction-based mechanisms, and optimization

Evolutionary Route Planner for Unmanned Air Vehicles