Abstract:Driver-preferred route planning often evaluates the quality of a planned route based on how closely it is followed by the driver. Despite decades of research in this area, there still exist nonnegligible deviations from planned routes. Recently, with the prevalence of GPS data, Inverse Reinforcement Learning (IRL) has attracted much interest due to its ability to directly learn routing patterns from GPS trajectories. However, existing IRL methods are limited in that: (1) They rely on numerical approximations to calculate the expected state visitation frequencies (SVFs), which are inaccurate and time-consuming; and (2) They ignore the fact that the coverage of GPS trajectories is skewed toward popular road segments, causing difficulties in learning from sparsely covered ones. To overcome these challenges, we propose a recursive logit-based meta-IRL approach, where (1) We use the recursive logit model to capture drivers' route choice behavior so that the expected SVFs can be analytically derived, which substantially reduces the computational efforts; and (2) We introduce meta-parameters and employ meta-learning techniques so that the learning on sparsely covered road segments can benefit from that on popular ones. When training our IRL model, we update the rewards of road segments with the expected SVFs by solving several systems of linear equations and update the meta-parameters through a two-level optimization structure to ensure its fast adaption and versatility. We validate our approach using real GPS data in Chengdu, China. Results show that our planned routes better match actual routes compared with state-of-the-art methods including the recursive logit model, Deep-IRL and Dij-IRL: the F1-Score increases by 4.17% with the introduction of the recursive logit model and further increases to 5.19% after meta-learning is employed. Moreover, we can reduce training time by over 95%.

Integrating Dijkstra’s Algorithm into Deep Inverse Reinforcement Learning for Food Delivery Route Planning

Personalized Route Recommendation for Ride-Hailing with Deep Inverse Reinforcement Learning and Real-Time Traffic Conditions

ILRoute: A Graph-based Imitation Learning Method to Unveil Riders’ Routing Strategies in Food Delivery Service

Recursive logit-based meta-inverse reinforcement learning for driver-preferred route planning

DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route Prediction

An Online Deep Reinforcement Learning-Based Order Recommendation Framework for Rider-Centered Food Delivery System

A deep reinforcement learning with dynamic spatio-temporal graph model for solving urban logistics delivery planning problems

A deep inverse reinforcement learning approach to route choice modeling with context-dependent rewards

Solving the vehicle-drone pickup and delivery problem in road congestion: A heuristic and its deep reinforcement learning-based improvement

Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Time

A Four-stage Heuristic Algorithm for Solving On-demand Meal Delivery Routing Problem

Cycling Map Inference Using Global Positioning System Trajectories: A Case Study in the Online Food Delivery Business

An End-to-End Reinforcement Learning Based Approach for Micro-View Order-Dispatching in Ride-Hailing

An integrated route planning approach for driverless vehicle delivery system

Multi-sensor Data-driven Route Prediction in Instant Delivery with a 3-Conversion Network

A Joint Inverse Reinforcement Learning and Deep Learning Model for Drivers' Behavioral Prediction

A hierarchical deep reinforcement learning method for solving urban route planning problems under large-scale customers and real-time traffic conditions

A Predictive-Reactive Optimization Framework With Feedback-Based Knowledge Distillation for On-Demand Food Delivery

Solving two-stage stochastic route-planning problem in milliseconds via end-to-end deep learning

An XGBoost-enhanced Fast Constructive Algorithm for Food Delivery Route Planning Problem

A Matching Algorithm with Reinforcement Learning and Decoupling Strategy for Order Dispatching in On-Demand Food Delivery