Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Transferable Representation Model Driven by Gaussion Process Regression for Real-time Energy Management of Plug-in Hybrid Vehicles

Transferable representation modelling for real-time energy management of the plug-in hybrid vehicle based on k-fold fuzzy learning and Gaussian process regression

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Knowledge Implementation and Transfer With an Adaptive Learning Network for Real-Time Power Management of the Plug-in Hybrid Vehicle

Predictive Energy Management of Plug-in Hybrid Electric Vehicles by Real-time Optimization and Data-driven Calibration

A predictive energy management strategy for multi-mode plug-in hybrid electric vehicles based on multi neural networks

A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles

Adaptive Hierarchical Energy Management Design for a Plug-In Hybrid Electric Vehicle.

K-FOLD FUZZY LEARNING FOR IMPLEMENTATION OF DYNAMIC PROGRAMMING RESULTS IN REAL-TIME ENERGY MANAGEMENT OF THE PLUG-IN HYBRID VEHICLE

Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation

Real-Time Energy Management for Plug-in Hybrid Electric Vehicles via Incorporating Double-Delay Q-Learning and Model Prediction Control

An Energy Management Strategy of Power-Split Hybrid Electric Vehicles Using Reinforcement Learning

Data-driven modeling and supervisory control system optimization for plug-in hybrid electric vehicles

Optimizing Hybrid Electric Vehicle Coupling Organic Rankine Cycle Energy Management Strategy Via Deep Reinforcement Learning

Continuous Reinforcement Learning-Based Energy Management Strategy for Hybrid Electric-Tracked Vehicles

Convex optimization-based predictive and bi-level energy management for plug-in hybrid electric vehicles

Prediction of vehicle driving conditions with incorporation of stochastic forecasting and machine learning and a case study in energy management of plug-in hybrid electric vehicles

Model Prediction and Rule Based Energy Management Strategy for Hybrid Energy Storage System

Energy Management for a Power-Split Plug-in Hybrid Electric Vehicle Based on Dynamic Programming and Neural Networks

Neural Network Energy Management Strategy with Optimal Input Features for Plug-in Hybrid Electric Vehicles

Modeling and Control System Optimization for Electrified Vehicles: A Data-Driven Approach