Abstract:With the growing proportion of renewable energy sources in power grid, the demands for deep peak shaving and rapid load regulation of ultra-supercritical (USC) unit to provide more flexible and stable power services is further enhanced. Simultaneously, the load tracking speed is no longer the only significant task in the flexible operation of USC unit, the operational economy is more and more important. To this end, a hierarchical reinforcement learning GPC control scheme with a better economy is proposed and apply to USC unit. Firstly, the model mismatch problem in control process is taken into account, and an integral mode is added into the GPC to eliminate the steady state error during the load regulation. Secondly, the hierarchical reinforcement learning GPC scheme integrated the GPC and twin delayed deep deterministic policy gradient algorithms is presented. The complex flexibility demand problem is decomposed into rapid load regulation and economic operation and then respectively solved in the GPC-based upper layer and reinforcement learning agent-based lower layer. Thirdly, under the flexibility demand, a multi-criteria optimization function including the load tracking cost, main steam throttling loss and coal consumption rate of unit is constructed. Then, via the accurate trajectory tracking by GPC and on-line control sequence optimization by reinforcement learning agent, the operational flexibility and economy of USC unit are simultaneously improved within safe boundaries. Finally, to verify the availability of the proposed hierarchical reinforcement learning GPC strategy, large-scale load variations and disturbance rejection ability tests cover the 30%–100 % rated load of a 1000 MW USC unit are carried out, and the load regulation performance is compared to other strategies. Results confirm that the designed hierarchical reinforcement learning GPC control scheme is profit for the flexible and economic operation capability promotion of USC unit.

An optimal hierarchical control scheme for smart generation units: an application to combined steam and electricity generation

Optimal Control of Generators and Series Compensators Within Multi-space-time Scale

A Hierarchical Architecture for Optimal Unit Commitment and Control of an Ensemble of Steam Generators

Predictive control of a combined heat and power plant for grid flexibility under demand uncertainty

A Hierarchical Architecture for the Coordination of an Ensemble of Steam Generators

Distributed Optimal Scheduling of Multi-Microgrid System with Hydrogen Based on Model Predictive Control

A hierarchical energy management strategy for grid-connected microgrid

A hierarchical genetic algorithm and mixed-integer linear programming-based stochastic optimization of the configuration of integrated trigeneration energy systems

A hierarchical reinforcement learning GPC for flexible operation of ultra-supercritical unit considering economy

Smart management of integrated energy systems through co-optimization with long and short horizons

A novel two-stage multi-objective dispatch model for a distributed hybrid CCHP system considering source-load fluctuations mitigation

Closed-Loop Hierarchical Operation for Optimal Unit Commitment and Dispatch in Microgrids: A Hybrid System Approach

Research of coordinated optimal control strategy between units and grid based on hierarchical event-driving control

Decentralized Optimization of Coordinated Electrical and Thermal Generations in Hierarchical Integrated Energy Systems Considering Competitive Individuals

Optimal Control of Power Flows and Energy Local Storages in a Network of Microgrids Modeled as a System of Systems

Hierarchical Control and Economic Optimization of Microgrids Considering the Randomness of Power Generation and Load Demand

Power System'S Optimal Coordinated Control System Based On Hierarchical Control

Supervisory Optimization of the MGT-CCHP System Using Model Predictive Control

Optimal Multiobjective Control of Low-Voltage AC Microgrids: Power Flow Regulation and Compensation of Reactive Power and Unbalance

Optimal Energy Management Design Using Bi-Level Model Predictive Control for Multiple Time Scales

Dynamic Optimization Model Of Agc Strategy Under Cps For Interconnected Power System