Abstract:Electric vehicles (EVs) are more environmentally friendly than gasoline vehicles (GVs). To reduce environmental pollution caused by ride-hailing gasoline vehicles (RGVs), they have been grad-ually replaced with ride-hailing electric vehicles (REVs). Like RGVs, REVs can allow passengers to share trips with others. However, REVs are plagued by charging needs in daily operations. This study develops a simulation-optimization framework for the dynamic electric ride-hailing sharing problem. This problem integrates a dynamic electric ride-hailing matching problem (with sharing) and a dynamic REV charging problem, both of which aim to match REVs to passengers willing to share their trips with others and schedule the charging events of REVs on temporal and spatial scales, respectively. The dynamic electric ride-hailing matching problem is divided into a set of electric ride-hailing matching subproblems by a rolling horizon approach without a look-ahead period, while the dynamic REV charging problem is divided into a set of REV charging sub -problems by a rolling horizon approach with look-ahead periods. Each REV charging subproblem incorporates a novel charging strategy to determine the charging schedules of REVs and relieve the charging anxiety by considering the information of requests, REVs, and charging stations. Each REV charging subproblem is formulated as a mixed integer linear program (MILP), whereas each electric ride-hailing matching subproblem is formulated as a mixed integer nonlinear pro-gram (MINLP). The MINLP and MILP are solved by the artificial bee colony algorithm and CPLEX, respectively. The proposed simulation-optimization framework includes a simulation model which is used to mimic the operations of REVs and update and track the state of passengers and the charging processes at charging stations over time using the outputs of each MILP and MINLP. The results show that the proposed charging strategy outperforms the benchmarks with a shorter waiting time for charging and a higher matching percentage in the dynamic ride-hailing matching problem. The robustness of the proposed charging strategy is tested under different scenarios with changing the initial state of charge (SOC), the number of REVs, the number of charging piles at each charging station, the time to fully charge, and the distribution of charging piles. The results show that REV drivers can charge their vehicles more flexibly without waiting too long and then pick up more passengers under all test scenarios.

GMIX: Graph-based spatial–temporal multi-agent reinforcement learning for dynamic electric vehicle dispatching system

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

A Simulation–optimization Framework for a Dynamic Electric Ride-Hailing Sharing Problem with a Novel Charging Strategy

Hybrid Multi-Agent Reinforcement Learning for Electric Vehicle Resilience Control Towards a Low-Carbon Transition

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Multi-Agent Graph Reinforcement Learning Method for Electric Vehicle on-Route Charging Guidance in Coupled Transportation Electrification

Graph attention reinforcement learning with flexible matching policies for multi-depot vehicle routing problems

Multi-task dispatch of shared autonomous electric vehicles for Mobility-on-Demand services - combination of deep reinforcement learning and combinatorial optimization method

Multi-Vehicle Routing Problems with Soft Time Windows: A Multi-Agent Reinforcement Learning Approach

A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method

Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching

Multi-Agent Mix Hierarchical Deep Reinforcement Learning for Large-Scale Fleet Management

Real-time Control of Electric Autonomous Mobility-on-Demand Systems via Graph Reinforcement Learning

Graph Convolutional Network Based Multi-Objective Meta-Deep Q-Learning for Eco-Routing

Multi-agent Deep Reinforcement Learning for Resilience-Driven Routing and Scheduling of Mobile Energy Storage Systems

DQ-GAT: Towards Safe and Efficient Autonomous Driving With Deep Q-Learning and Graph Attention Networks

Multiagent Q-Learning Approach for the Recharging Scheduling of Electric Automated Guided Vehicles in Container Terminals

Optimising Stochastic Routing for Taxi Fleets with Model Enhanced Reinforcement Learning

Electric vehicle charging scheduling control strategy for the large-scale scenario with non-cooperative game-based multi-agent reinforcement learning

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch