Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Agent-based Modeling and Simulation on the Electric Vehicle Travelling Ability in the Smart Grid

Agent-Based Modeling and Simulation for Systematic Operations of Shared Automated Electric Vehicles

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Multi-Agent Based Simulation for Decentralized Electric Vehicle Charging Strategies and their Impacts

A hybrid simulation method for EVs' operation considering power grid and traffic information

Mobility-Aware Coordinated Charging for Electric Vehicles in VANET-Enhanced Smart Grid

Multi-Agent Based Simulation for Investigating Centralized Charging Strategies and their Impact on Electric Vehicle Home Charging Ecosystem

Multi-agent Modeling and Analysis of EV Users’ Travel Willingness Based on an Integrated Causal/statistical/behavioral Model

Modelling Electrical Car Diffusion Based on Agents

Multi-Agent Based Simulation for Investigating Electric Vehicle Adoption and Its Impacts on Electricity Distribution Grids and CO2 Emissions

Electric Vehicle Charging Simulation Framework Considering Traffic, User, and Power Grid

Load Modeling for Electric Taxi Battery Charging and Swapping Stations: Comparison Studies

Integration of Electric Vehicles into Power Grid based on Probabilistic Simulation

Modeling and Simulation of the EV Charging in a Residential Distribution Power Grid

Agent-Based Aggregated Behavior Modeling for Electric Vehicle Charging Load

A Statistical Modelling and Analysis of Residential Electric Vehicles' Charging Demand in Smart Grids

Toward Efficient Smart Management: A Review of Modeling and Optimization Approaches in Electric Vehicle-Transportation Network-Grid Integration

On the Movement Simulations of Electric Vehicles: A Behavioral Model-Based Approach

Evaluating the role of behavior and social class in electric vehicle adoption and charging demands

Electric vehicle navigation and cluster dispatch for reliable low-carbon traffic–Power systems

Bang-Bang Charging of Electrical Vehicles by Smart Grid Technology