Abstract:Smart grid delivers power with two-way flows of electricity and information with the support of information and communication technologies. Electric vehicles (EVs) with rechargeable batteries can be powered by external sources of electricity from the grid, and thus charging scheduling that guides low-battery EVs to charging services is significant for service quality improvement of EV drivers. The revolution of communications and data analytics driven by massive data in smart grid brings many challenges as well as chances for EV charging scheduling, and how to schedule EV charging in a smart and resilient way has inevitably become a crucial problem. Toward this end, we in this paper leverage the techniques of software defined networking and vehicular edge computing to investigate a joint problem of fast charging station selection and EV route planning. Our objective is to minimize the total overhead from users’ perspective, including time and charging fares in the whole process, considering charging availability and electricity price fluctuation. A deep reinforcement learning (DRL) based solution is proposed to determine an optimal charging scheduling policy for low-battery EVs. Besides, in response to dynamic EV charging, we further develop a resilient EV charging strategy based on incremental update, with EV drivers’ user experience being well considered. Extensive simulations demonstrate that our proposed DRL-based solution obtains near-optimal EV charging overhead with good adaptivity, and the solution with incremental update achieves much higher computation efficiency than conventional game-theoretical method in dynamic EV charging.

Constrained Large-Scale Real-Time EV Scheduling Based on Recurrent Deep Reinforcement Learning

Multi-objective Optimal Scheduling of Charging Stations Based on Deep Reinforcement Learning

Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning

Optimal EV Charging Scheduling Considering the Lack of Charging Facilities Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Constrained Double Deep Q-learning Network for EVs Charging Scheduling with Renewable Energy

A Multi-Agent Reinforcement Learning-Based Method for Multiple Electric Vehicles Charging Scheduling

A deep reinforcement learning-based charging scheduling approach with augmented Lagrangian for electric vehicles

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

A Constrained DRL-based Bi-Level Coordinated Method for Large-Scale EVs Charging

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Optimal Scheduling for Charging and Discharging of Electric Vehicles Based on Deep Reinforcement Learning

EV Charging Command Fast Allocation Approach based on Deep Reinforcement Learning with Safety Modules

A Deep Reinforcement Learning-Based Charging Scheduling Approach with Augmented Lagrangian for Electric Vehicle

Decentralized collaborative optimal scheduling for EV charging stations based on multi‐agent reinforcement learning

Real-Time Scheduling for Electric Vehicles Charging/Discharging Using Reinforcement Learning

Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning

Research on Multi-objective Charging Scheduling Strategy for Electric Vehicles: A Deep Reinforcement Learning Approach

Electric vehicle clusters scheduling strategy considering real-time electricity prices based on deep reinforcement learning

Optimal self-consumption scheduling of highway electric vehicle charging station based on multi-agent deep reinforcement learning

Smart and Resilient EV Charging in SDN-Enhanced Vehicular Edge Computing Networks