Abstract:Driver-preferred route planning often evaluates the quality of a planned route based on how closely it is followed by the driver. Despite decades of research in this area, there still exist nonnegligible deviations from planned routes. Recently, with the prevalence of GPS data, Inverse Reinforcement Learning (IRL) has attracted much interest due to its ability to directly learn routing patterns from GPS trajectories. However, existing IRL methods are limited in that: (1) They rely on numerical approximations to calculate the expected state visitation frequencies (SVFs), which are inaccurate and time-consuming; and (2) They ignore the fact that the coverage of GPS trajectories is skewed toward popular road segments, causing difficulties in learning from sparsely covered ones. To overcome these challenges, we propose a recursive logit-based meta-IRL approach, where (1) We use the recursive logit model to capture drivers' route choice behavior so that the expected SVFs can be analytically derived, which substantially reduces the computational efforts; and (2) We introduce meta-parameters and employ meta-learning techniques so that the learning on sparsely covered road segments can benefit from that on popular ones. When training our IRL model, we update the rewards of road segments with the expected SVFs by solving several systems of linear equations and update the meta-parameters through a two-level optimization structure to ensure its fast adaption and versatility. We validate our approach using real GPS data in Chengdu, China. Results show that our planned routes better match actual routes compared with state-of-the-art methods including the recursive logit model, Deep-IRL and Dij-IRL: the F1-Score increases by 4.17% with the introduction of the recursive logit model and further increases to 5.19% after meta-learning is employed. Moreover, we can reduce training time by over 95%.

Map matching on low sampling rate trajectories through deep inverse reinforcement learning and multi-intention modeling

Learning Road Network Index Structure for Efficient Map Matching

Map-matching based on driver behavior model and massive trajectories

Map matching when the map is wrong: Efficient vehicle tracking on- and off-road for map learning

Recursive logit-based meta-inverse reinforcement learning for driver-preferred route planning

Accurate Map Matching Method for Mobile Phone Signaling Data under Spatio-Temporal Uncertainty

Medark: a map-matching error detection and rectification framework for vehicle trajectories

IF-Matching: Towards Accurate Map-Matching with Information Fusion

Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories

Learning Reward Function with Matching Network for Mapless Navigation

Spatiotemporal Costmap Inference for MPC via Deep Inverse Reinforcement Learning

Reinforcement-Tracking: An Effective Trajectory Tracking and Navigation Method for Autonomous Urban Driving

Map-matching for Low-Sampling-rate GPS Trajectories

L2MM: Learning to Map Matching with Deep Models for Low-Quality GPS Trajectory Data

An Incremental Map-Matching Method Based on Road Network Topology

Deep learning enabled vehicle trajectory map‐matching method with advanced spatial–temporal analysis

Personalized Route Recommendation for Ride-Hailing with Deep Inverse Reinforcement Learning and Real-Time Traffic Conditions

Map Matching Based on Conditional Random Fields and Route Preference Mining for Uncertain Trajectories.

Multimodal Vehicular Trajectory Prediction with Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections

A deep inverse reinforcement learning approach to route choice modeling with context-dependent rewards

DeepMM: Deep Learning Based Map Matching with Data Augmentation