Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Research on Electric Vehicles Charging Mechanism Based on Multi-Agent System

Agent-Based Modeling and Simulation for Systematic Operations of Shared Automated Electric Vehicles

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Multi-agents Based Modelling for Distribution Network Operation with Electric Vehicle Integration

Multi-Agent System Based Coordinated Charging Strategy for Electric Vehicles

Design and Implementation of Simulation Software for Electric Vehicle Charging Behavior Based on Multi-agent System

Simulation Study of Electric Vehicle Charging Behavior Based on Multi-Agent System

A Multi-Agent Reinforcement Learning-Based Method for Multiple Electric Vehicles Charging Scheduling

A Multi-Agent System for Controlled Charging of a Large Population of Electric Vehicles

Multi-agent Based Simulation Architecture for Distribution System Regarding PEVs

Mobility-Aware Coordinated Charging for Electric Vehicles in VANET-Enhanced Smart Grid

Research and Development on Energy Management System of Electric Vehicles

Electric Taxi Charging Guidance Strategy Based on Electric Vehicle Agent-based Simulation

A Cooperative Charging Control Strategy for Electric Vehicles Based on Multiagent Deep Reinforcement Learning

Aggregation and Scheduling Methods of Electric Vehicle Agents Divided by Regions

A Cooperative Hierarchical Multi-Agent System for EV Charging Scheduling in Presence of Multiple Charging Stations

Optimizing Electric Vehicle Charging Infrastructure on Highways: A Multi-Agent-Based Planning Approach

A Two-Stage Multi-Agent EV Charging Coordination Scheme for Maximizing Grid Performance and Customer Satisfaction

Coordination of Multi-Agent Orderly Charging Via an Incentive-Compatible Mechanism

Research on Charging and Discharging Dispatching Strategy for Electric Vehicles

The Impact of Electric Vehicle Penetration and Charging Patterns on the Management of Energy Hub – A Multi-Agent System Simulation