Abstract:In modern, large scale interconnected power grids, low-frequency oscillation is a key roadblock to improved power transmission capacity. Supplementary generator control, flexible AC transmission system (FACTS), and high voltage direct currents (HVDC) are engineered devices designed to damp such low frequency swings. In this paper a neural network-based approximate dynamic programming method, namely direct heuristic dynamic programming (direct HDP), is applied to power system stability enhancement. Direct HDP is a learning and approximation based approach to addressing nonlinear system control problems under uncertainty, and it is also a model-free design strategy. The action and critic networks of the direct HDP are implemented using multi-layer perceptrons; learning is carried out based on the interactions between the controller and the power system. For this design approach, real time system responses are provided through wide-area measurement system (WAMS). The controller learning objective is formulated as a reward function that reflects global characteristics of the power system under low frequency oscillation, as well as tight coupling effects among system components. Direct HDP control design is illustrated by case studies, which are also used to demonstrate the learning control performance. The proposed direct HDP learning control is also developed as a new solution to a large scale system coordination problem by using the China Southern Power Grid as a major test bed.

Direct Heuristic Dynamic Programming Method for Power System Stability Enhancement

Convergence of Direct Heuristic Dynamic Programming in Power System Stability Control.

Direct heuristic dynamic programming for damping oscillations in a large power system.

Supplementary Damping Controller Design Using Direct Heuristic Dynamic Programming in Complex Power Systems

Direct Neural Dynamic Programming Method for Power System Stability Enhancement

Coordinated Control of Power System Based on Direct Neural Dynamic Programming Method

Approximate Dynamic Programming Coordinated Control In Multi-Infeed Hvdc Power System

Power System Stability Control for a Wind Farm Based on Adaptive Dynamic Programming

Adaptive Non-Linear Neural Control of Wide-Area Power Systems

An Efficient Parallel Sequential Approach for Transient Stability Emergency Control of Large-Scale Power System

Decentralized Nonlinear Excitation Control Based on Wide-Area Measurements

Hybrid Frequency-Domain Modeling and Stability Analysis for Power Systems with Grid-Following and Grid-Forming Converters

An Efficient Optimal Control Method for Open-Loop Transient Stability Emergency Control

Wide-Area Time-Delay Robust Damping Control For Power System

A Fast Dynamic Optimization Approach for Transient Stability Emergency Control

Approximate dynamic programming for continuous state and control problems

Direct Heuristic Dynamic Programming Based on an Improved PID Neural Network

Real-time Optimisation of Short-Term Frequency Stability Controls for a Power System with Renewables and Multi-Infeed HVDCs

Machine Learning Based State-Space Approximate Dynamic Programming Approach for Energy and Reserve Management of Power Plants

Direct Heuristic Dynamic Programming with Augmented States

Heuristic Dynamic Programming for Adaptive Virtual Synchronous Generators