Abstract:To learn human intelligence, the social system/human system is added to a cyber-physical energy system in this paper. To accelerate the configuration process of the parameters of the cyber-physical energy system, parallel systems based on artificial societies-computational experiments-parallel execution are added to the cyber-physical energy system, i.e., a parallel cyber-physical-social energy system is proposed in this paper. This paper proposes a real-time generation control framework to replace the conventional generation control framework with multiple time scales, which consist of long-term time scale, short-term time scale, and real-time scale. Since a lazy operator employed into reinforcement learning, a lazy reinforcement learning is proposed for the real-time generation control framework. To reduce the real simulation time, multiple virtual parallel cyber-physical-social energy systems and a real parallel cyber-physical-social energy system are built for the real-time generation control of large-scale multi-area interconnected power systems. Compared with a total of 146016 conventional generation control algorithms and a relaxed artificial neural network in the simulation of IEEE 10-generator 39-bus New-England power system, the proposed lazy reinforcement learning based real-time generation control controller can obtain the highest control performance. The active power between two areas and the systemic frequency deviation can be reduced by the lazy reinforcement learning, and the simulation results verify the effectiveness and feasibility of the proposed lazy reinforcement learning based real-time generation control controller for the parallel cyber-physical-social energy systems.

Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Emotional Deep Learning Programming Controller for Automatic Voltage Control of Power Systems

Intelligent Flink Framework Aided Real-Time Voltage Computing Systems in Autonomous and Controllable Environments

Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems

Expandable quantum deep width learning-based distributed voltage control for smart grids with high penetration of distributed energy resources

Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recovery

Lazy reinforcement learning for real-time generation control of parallel cyber-physical-social energy systems

Artificial emotionnal Q-learning for automatic generation control of interconnected power grids

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

A Hybrid Randomized Learning System for Temporal-Adaptive Voltage Stability Assessment of Power Systems

Multi-Agent Deep Reinforcement Learning for Voltage Control with Coordinated Active and Reactive Power Optimization

Fractional-order Q-learning Based on Modal Decomposition and Convolutional Neural Networks for Voltage Control of Smart Grids

Decentralized Graphical-Representation-Enabled Multi-Agent Deep Reinforcement Learning for Robust Control of Cyber-Physical Systems

Multi-agent Edge-Learning Based Real-Time Voltage Control for Active Distribution Network with Prediction Uncertainties Tolerance

Expandable Deep Width Learning for Voltage Control of Three-State Energy Model Based Smart Grids Containing Flexible Energy Sources

Virtual Power Plant Reactive Power Voltage Support Strategy Based on Deep Reinforcement Learning

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

A Hybrid Optimization and Deep Learning Algorithm for Cyber-resilient DER Control

A Data-Driven Method for Power System Emergency Control to Improve Short-Term Voltage Stability