Abstract:The DC bus voltage of AC/DC converters is conventionally regulated by proportional plus integral (PI)-based controllers. However, such controllers can’t provide good performance over the entire operating region and their performance is also affected by the change of parameters of passive components depending on temperature during the converters’ operation. On the other hand, reinforcement learning (RL), which is one of the machine learning methods, can become immune to parameter changes as it maintains training during the converter operation. In this paper, an RL-based control algorithm is proposed for an AC/DC dual active bridge (DAB) converter which operates with improved hybrid current modulation (iHCM). In the proposed method, the model-free Q-learning algorithm of RL is used to train an agent to regulate the DC bus voltage. The proposed algorithm is verified for various load and disturbance conditions by MATLAB/Simulink simulations, and it is compared with a PI controller which is tuned with Internal Model Control (IMC) method. According to the simulation results, besides the online learning advantage, the proposed method creates a small settling time and overshoot at the start-up for light load conditions, unlike the PI controller. On the other hand, during the change of dynamic load and AC grid voltage, it creates smaller voltage oscillations in the output DC voltage and regulates it faster. Furthermore, since the proposed method keeps the duty cycle value constant in each grid period, it produces lower total harmonic distortion (THD) than the PI controller.

A New Robust Integral Reinforcement Learning Based Control Algorithm for Interleaved DC/DC Boost Converter

A Digital Dual-Mode Lqr Optimal Controller for Boost Converter over A Wide Operation Range

Predictive Control of Voltage Source Inverter: an Online Reinforcement Learning Solution

Predictor-Based Data-Driven Model-Free Adaptive Predictive Control of Power Converters Using Machine Learning

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Nonlinear adaptive control based on RBF networks and multi-model method

Analogue Implementation of A Neural Network Controller for Ups Inverter Applications

A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid

Combining Data-Driven and Event-Driven for Online Learning Predictive Control in Power Converters

An Intelligent Control Strategy for buck DC-DC Converter via Deep Reinforcement Learning

Predictor-Based Neural Network Finite-Set Predictive Control for Modular Multilevel Converter

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Reinforcement learning-based control of improved hybrid current modulated dual active bridge AC/DC converter

Robust Adaptive Control of Interleaved Boost Converter for Fuel Cell Application

Finite Control-Set Learning Predictive Control for Power Converters

Data-based neural controls for an unknown continuous-time multi-input system with integral reinforcement

Reinforcement Learning-Based Control of a Power Electronic Converter

Dynamic Control of Three-Phase Dual-Active-Bridge DC-DC Converters Based on Sliding-Mode-Learning Adaline

Reinforcement Learning Based Integrated Control to Improve the Efficiency of DC Microgrids

A new effective robust nonlinear controller based on PSO for interleaved DC–DC boost converters for fuel cell voltage regulation

Deep Deterministic Policy Gradient Algorithm Based Reinforcement Learning Controller for Single-Inductor Multiple-Output DC–DC Converter