Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

A Machine Learning Approach to Boost the Vehicle-2-Grid Scheduling

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Distributed Optimal Vehicle Grid Integration Strategy with User Behavior Prediction

A Deep Q-Learning based Smart Scheduling of EVs for Demand Response in Smart Grids

Online EVs Vehicle-to-Grid Scheduling Coordinated with Multi-Energy Microgrids: A Deep Reinforcement Learning-Based Approach

Heuristic Greedy Scheduling of Electric Vehicles in Vehicle-to-Grid Microgrid Owned Aggregators

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Boosting Grid Efficiency and Resiliency by Releasing V2G Potentiality Through a Novel Rolling Prediction-Decision Framework and Deep-LSTM Algorithm

Optimal Scheduling of Vehicle-to-Grid Electric Vehicles in Photovoltaic Microgrid

Optimal scheduling for vehicle-to-grid operation with stochastic connection of plug-in electric vehicles to smart grid

Optimal Charging Scheduling for Large-Scale Ev (electric Vehicle) Deployment Based on the Interaction of the Smart-Grid and Intelligent-Transport Systems

Research on Multi-objective Charging Scheduling Strategy for Electric Vehicles: A Deep Reinforcement Learning Approach

A multi-level vehicle-to-grid optimal scheduling approach with EV economic dispatching model

Grid-aware Scheduling and Control of Electric Vehicle Charging Stations for Dispatching Active Distribution Networks. Part-I: Day-ahead and Numerical Validation

Minimization of Load Variance in Power Grids—Investigation on Optimal Vehicle-to-Grid Scheduling

Optimizing the performance of vehicle-to-grid (V2G) enabled battery electric vehicles through a smart charge scheduling model

Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming

Energy Scheduling and Allocation in Electric Vehicle Energy Distribution Networks

Electric Vehicle Charging System in the Smart Grid Using Different Machine Learning Methods

A Day-ahead Scheduling Strategy for Electric vehicles Based on Converted Economical Objective

Coordinate Scheduling of Electric Vehicles in Charging Stations Supported by Microgrids