Abstract:Power grid is probably the most complex engineering system in the world. The dominated centralized schemes for power system require complicated communication network to collect global operating condition and a powerful central controller to process the huge amount of data. In addition, centralized schemes lack flexibility and cannot easily adapt to intentional/unintentional network topology changes. Since distributed control schemes are more flexible, reliable, and cheaper to implement, they are promising choice for smart grid upgrade. To address the needs of power systems and problems with existing solutions, the author proposes several fully distributed multi-agent system (MAS) based algorithms based on the most recent developments of control and optimization theory, which have been successfully applied to load management, optimal reactive power dispatch (ORPD), cooperation of multiple renewable generators (RGs), and optimal resource allocation. For load management, a fully distributed consensus based global information discovery algorithm is proposed to discover the global net active power, loading level and load connection information. The information discovery algorithm can guarantee convergence for power systems of any size and topology and is robust against certain types of faults. For OPRD, a distributed MAS based Q-learning algorithm is utilized to coordinate the control settings of reactive control devices to minimize the active power loss while satisfying certain operation constraints. The proposed algorithm is model free and can adapt to changes of system operating conditions automatically. For the coordination of multiple RGs in a microgrid, a distributed subgradient-based control scheme is proposed to synchronize the utilization levels of RGs based on local frequency measurement and available generation prediction. The proposed control scheme can be applied to the power systems with different types of generators under both excessive and insufficient renewable generations. For optimal resource allocation, a fully distributed pricing strategy is proposed to maximize the social welfare, while respecting system constraints. The effectiveness of the all proposed algorithms has been demonstrated through simulations. The corresponding work has produced five papers in the IEEE transactions on Power Systems, Smart Grid and Systems, Man, and Cybernetics.

Decentralized Reinforcement Learning Collaborative Consensus Algorithm for Generation Dispatch in Virtual Generation Tribe

Distributed Virtual Incremental Cost Consensus Algorithm For Economic Dispatch In A Microgrid

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Distributed Consensus Based Supply–Demand Balance Algorithm for Economic Dispatch Problem in a Smart Grid with Switching Graph

A Distributed Consensus Based Algorithm for Economic Dispatch over Time‐varying Digraphs

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Multi-Agent System Based Optimal Power Dispatch Algorithm for Microgrid

Convergence Speed Analysis and Optimization for Distributed Control of Virtual Power Plant

Distributed optimization for economic power dispatch with event-triggered communication

Consensus Based Distributed Reinforcement Learning For Nonconvex Economic Power Dispatch In Microgrids

The Leader Election Criterion for Decentralized Economic Dispatch Using Incremental Cost Consensus Algorithm

Decentralizing the economic dispatch problem using a two-level incremental cost consensus algorithm in a smart grid environment

Consensus-based distributed energy management with real-time pricing

Incremental Cost Consensus Algorithm in a Smart Grid Environment

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Novel distributed algorithms for power systems operations

Consensus-Based Decentralized Optimization for Distributed Generators Power Allocation Over Time-Varying Digraphs in Microgrids

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Agent-based Distributed Consensus Algorithm for Decentralized Economic Dispatch in Smart Grid