Abstract:The stability of a hybrid AC-DC microgrid depends mainly upon the bidirectional interlinking converter (BIC), which is responsible for power transfer, power balance, voltage solidity, frequency and transients sanity. The varying generation from renewable resources, fluctuating loads, and bidirectional power flow from the utility grid, charging station, super-capacitor, and batteries produce various stability issues on hybrid microgrids, like net active-reactive power flow on the AC-bus, frequency oscillations, total harmonic distortion (THD), and voltage variations. Therefore, the control of BIC between AC and DC buses in grid-connected hybrid microgrid power systems is of great importance for the quality/smooth operation of power flow, power sharing and stability of the whole power system. In literature, various control schemes are suggested, like conventional droop control, communication-based control, model predictive control, etc., each addressing different stability issues of hybrid AC-DC microgrids. However, model dependence, single-point-failure (SPF), communication vulnerability, complex computations, and complicated multilayer structures motivated the authors to develop online adaptive neural network (NN) Q-learning-based full recurrent adaptive neurofuzzy nonlinear control paradigms for BIC in a grid-connected hybrid AC-DC microgrid. The proposed strategies successfully ensure the following: (i) frequency stabilization, (ii) THD reduction, (iii) voltage normalization and (iv) negligible net active-reactive power flow on the AC-bus. Three novel adaptive NN Q-learning-based full recurrent adaptive neurofuzzy nonlinear control paradigms are proposed for PQ-control of BIC in a grid-connected hybrid AC-DC microgrid. The control schemes are based on NN Q-learning and full recurrent adaptive neurofuzzy identifiers. Hybrid adaptive full recurrent Legendre wavelet-based Neural Network Q-learning-based full recurrent adaptive NeuroFuzzy control, Hybrid adaptive full recurrent Mexican hat wavelet-based Neural Network Q-learning-based full recurrent adaptive NeuroFuzzy control, and Hybrid adaptive full recurrent Morlet wavelet-based Neural Network Q-learning-based full recurrent adaptive NeuroFuzzy control are modeled and tested for the control of BIC. The controllers differ from each other, based on variants used in the antecedent part (Gaussian membership function and B-Spline membership function), and consequent part (Legendre wavelet, Mexican hat wavelet, and Morlet wavelet) of the full recurrent adaptive neurofuzzy identifiers. The performance of the proposed control schemes was validated for various quality and stability parameters, using a simulation testbench in MATLAB/Simulink. The simulation results were bench-marked against an aPID controller, and each proposed control scheme, for a simulation time of a complete solar day.

Fractional-order Q-learning Based on Modal Decomposition and Convolutional Neural Networks for Voltage Control of Smart Grids

Multi-Agent Q-Value Mixing Network with Covariance Matrix Adaptation Strategy for the Voltage Regulation Problem

Two-stage Voltage Regulation in Power Distribution System Using Graph Convolutional Network-Based Deep Reinforcement Learning in Real Time

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Adaptive Neural Network Q-Learning-Based Full Recurrent Adaptive NeuroFuzzy Nonlinear Control Paradigms for Bidirectional-Interlinking Converter in a Grid-Connected Hybrid AC-DC Microgrid

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Deep Reinforcement Learning Based Robust Control Strategy for Power Sharing and Voltage Regulation in DC Grid-Forming Energy Storage System

Multi-Agent Deep Reinforcement Learning for Voltage Control with Coordinated Active and Reactive Power Optimization

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning

A Scalable Network-Aware Multi-Agent Reinforcement Learning Framework for Decentralized Inverter-based Voltage Control

Q-Learning Approach for Hierarchical Agc Scheme of Interconnected Power Grids

Multi-regional Reactive Power Optimization Based on Correlated Equilibrium Q-learning Collaborative Algorithm

Q-learning-based Dynamic Optimal Allocation Algorithm for CPS Order of Interconnected Power Grids

Robust Regional Coordination of Inverter-Based Volt/Var Control Via Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning-Based Distributed Voltage Control of Flexible Distribution Networks with Soft Open Points

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

CNN-LSTM based power grid voltage stability emergency control coordination strategy

Consensus Multi-Agent Reinforcement Learning for Volt-VAR Control in Power Distribution Networks

Learning Provably Stable Local Volt/Var Controllers for Efficient Network Operation