Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Multi-objective Optimal Trade-off Between V2G Activities and Battery Degradation in Electric Mobility-as-a-Service Systems

Scenario analysis, management, and optimization of a new Vehicle-to-Micro-Grid (V2G) network based on off-grid renewable building energy systems

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Multi-objective stochastic techno-economic-environmental optimization of distribution networks with G2V and V2G systems

Optimal Day-Ahead Transport and Charge Scheduling of Autonomous Electric Vehicle Fleet using Local Renewable Energy Generation

Optimizing Electric Carsharing System Operations and Battery Management: Integrating V2G, B2G and Battery Swapping Strategies

Mobility-Aware Vehicle-to-Grid (V2G) Optimization for Uniform Utilization in Smart Grid Based Power Distribution Network

Electric Autonomous Mobility-on-Demand: Jointly Optimal Vehicle Design and Fleet Operation

Optimizing the performance of vehicle-to-grid (V2G) enabled battery electric vehicles through a smart charge scheduling model

Multi-Objective Optimal Charging Control of Plug-In Hybrid Electric Vehicles in Power Distribution Systems

Locating Charging Infrastructure for Shared Autonomous Electric Vehicles and for Vehicle-to-Grid Strategy: A Systematic Review and Research Agenda from an Energy and Mobility Perspective

Leveraging Owners' Flexibility in Smart Charge/Discharge Scheduling of Electric Vehicles to Support Renewable Energy Integration

Optimal Energy and Reserve Market Management in Renewable Microgrid-PEVs Parking Lot Systems: V2G, Demand Response and Sustainability Costs

Integrated optimization of charging infrastructure, fleet size and vehicle operation in shared autonomous electric vehicle system considering vehicle-to-grid

V2G Multi-Objective Optimization Considering Data-Driven User's Demand Response

V2G Multi-Objective Dispatching Optimization Strategy Based on User Behavior Model

Electric Autonomous Mobility-on-Demand: Joint Optimization of Routing and Charging Infrastructure Siting

Event-Driven Real-Time Multi-Objective Charging Schedule Optimization For Electric Vehicle Fleets

Vehicle-to-grid enabled charging infrastructure planning and operations considering demand uncertainties

Cost-benefit analysis for multiple agents considering an electric vehicle charging/discharging strategy and grid integration

Optimization of Grid Energy Balance Using Vehicle-to-Grid Network System