DClEVerNet: Deep Combinatorial Learning for Efficient EV Charging Scheduling in Large-scale Networked Facilities

Bushra Alshehhi,Areg Karapetyan,Khaled Elbassioni,Sid Chi-Kin Chau,Majid Khonji

DOI: https://doi.org/10.1145/3575813.3595205

2023-08-22

Abstract:With the electrification of transportation, the rising uptake of electric vehicles (EVs) might stress distribution networks significantly, leaving their performance degraded and stability jeopardized. To accommodate these new loads cost-effectively, modern power grids require coordinated or ``smart'' charging strategies capable of optimizing EV charging scheduling in a scalable and efficient fashion. With this in view, the present work focuses on reservation management programs for large-scale, networked EV charging stations. We formulate a time-coupled binary optimization problem that maximizes EV users' total welfare gain while accounting for the network's available power capacity and stations' occupancy limits. To tackle the problem at scale while retaining high solution quality, a data-driven optimization framework combining techniques from the fields of Deep Learning and Approximation Algorithms is introduced. The framework's key ingredient is a novel input-output processing scheme for neural networks that allows direct extrapolation to problem sizes substantially larger than those included in the training set. Extensive numerical simulations based on synthetic and real-world data traces verify the effectiveness and superiority of the presented approach over two representative scheduling algorithms. Lastly, we round up the contributions by listing several immediate extensions to the proposed framework and outlining the prospects for further exploration.

Machine Learning

What problem does this paper attempt to address?

### The Problem the Paper Attempts to Solve This paper aims to address the optimization problem of electric vehicle (EV) charging scheduling in large-scale networked facilities. Specifically, with the increase in the number of electric vehicles, significant pressure is placed on the power grid, leading to performance degradation and stability issues. To effectively tackle this challenge, modern power grids need to coordinate or implement "smart" charging strategies to optimize the charging schedules of large-scale networked charging stations. The focus of this paper is on developing a reservation management system for large-scale networked electric vehicle charging stations. The authors formalize the problem as a time-coupled binary optimization problem, which aims to maximize the total welfare benefits of EV users while considering the available power capacity of the network and the occupancy constraints of the charging stations. To efficiently solve this problem on a large scale while maintaining high solution quality, the paper introduces a data-driven optimization framework that combines deep learning with approximation algorithm techniques. The key to this framework is the proposal of a novel input-output processing scheme that allows the neural network to directly extrapolate to problem instances much larger than the training set. Extensive numerical simulations based on synthetic data and real-world data trajectories validate the effectiveness and superiority of the proposed method, and it is compared with two other representative scheduling algorithms. Finally, the authors list some direct extensions of the framework and outline prospects for further exploration.

DClEVerNet: Deep Combinatorial Learning for Efficient EV Charging Scheduling in Large-scale Networked Facilities

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Smart and Resilient EV Charging in SDN-Enhanced Vehicular Edge Computing Networks

Constrained Large-Scale Real-Time EV Scheduling Based on Recurrent Deep Reinforcement Learning

Network-aware electric vehicle charging/discharging scheduling for grid load management in a hierarchical framework

A cooperative EV charging scheduling strategy based on double deep Q-network and Prioritized experience replay

Multi-objective Optimal Scheduling of Charging Stations Based on Deep Reinforcement Learning

Constrained Double Deep Q-learning Network for EVs Charging Scheduling with Renewable Energy

Optimal EV Charging Scheduling Considering the Lack of Charging Facilities Based on Deep Reinforcement Learning

Hierarchical Distributed Framework for EV Charging Scheduling Using Exchange Problem

Research on Multi-objective Charging Scheduling Strategy for Electric Vehicles: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

An Efficient Distributed Multi-Agent Reinforcement Learning for EV Charging Network Control

PROLIFIC: Deep Reinforcement Learning for Efficient EV Fleet Scheduling and Charging

A Game-theoretic Approach for Dynamic Service Scheduling at Charging Facilities

A novel two-stage game theory-based data-driven coordination control for efficient power allocation and EV charging management

Optimal Scheduling of Electric Vehicle Charging with Deep Reinforcement Learning considering End Users Flexibility

Algorithms for Electric Vehicle Scheduling in Smart Distribution Networks

Joint Charging Scheduling and Computation Offloading in EV-Assisted Edge Computing: A Safe DRL Approach

Enhanced Coordinated Operations of Electric Power and Transportation Networks Via EV Charging Services