Abstract:This paper presents a novel model-free switching and control method for three-level neutral point clamped (NPC) converter using deep reinforcement learning (DRL). Our approach targets two primary control objectives: voltage balancing and current control. In this method, voltage balancing, current control and selection of optimal switches are achieved using a reward function which is calculated based on various signals measured as observations of the DRL agent. Since the action space is discrete, a deep Q-network (DQN) agent is utilized. DQN is used due to its capability of handling high-dimensional state spaces. In order to highlight its pros and cons, the proposed method is compared with model predictive control (MPC), which is another popular non-linear control method for power electronic converters. The proposed method is evaluated and compared with the MPC method in grid-connected mode using simulations in Matlab/Simulink. To evaluate the practical performance of the DRL method, various experimental results are obtained. The simulation and experimental results demonstrate that the proposed method effectively achieves accurate voltage balancing and ensures steady operation even in the presence of various dynamic changes, including variations in the reference currents and grid voltage. Additionally, the method successfully handles uncertainties, such as sensor measurement noise, and accommodates parameter variations, such as changes in the capacity of the DC-link capacitors and line impedance. The results demonstrate that this method exhibits superior adaptability to real-time changes and uncertainties, delivering more robust performance compared to similar conventional methods like MPC. Thus, this method can be considered a promising approach for intelligent control of power electronic converters, especially when conventional methods such as MPC face challenges in performance and accuracy under severe parameter variations and uncertainties.

A New Approach in Optimal Control of Step-Down Converters Based on a Switch-State Controller

A Digital Dual-Mode Lqr Optimal Controller for Boost Converter over A Wide Operation Range

Digital LQR Steady-State Optimal Control with Feedforward for Nonminimum Phase Boost DC-DC Converter

Dual-Mode Lqr-Feedforward Optimal Control for Non-Minimum Phase Boost Converter

Design and Analysis of an Optimal Controller for Parallel Multi-Inverter Systems

Modeling and Control for DC-DC Converters Based on Hybrid System

Stabilization Of Dc-Dc Buck Power Converter Feeding A Mixed Load Using Passivity-Based Control With Nonlinear Disturbance Observer

Using Optimization Algorithms for Control of Multiple Output DC-DC Converters

Modeling and Decoupled Control of A Non-Isolated High Step-Up/Down Bidirectional Dc-Dc Converter

Sampled-Data Control with Adjustable Switching Frequency for DC–DC Converters

Optimal Design and Control of 5kw PWM Plus Phase-Shift (PPS) Control Bidirectional Dc-Dc Converter

Optimal Control of Multi-Level DAB Converters for Soft-Switching and Minimum Current Stress

Dynamic Sensorless Control Approach for Markovian Switching Systems Applied to PWM DC–DC Converters with Time-Delay and Partial Input Saturation

Advanced digital control strategies for switching buck converters: A modeling perspective

A Model-Free Switching and Control Method for Three-Level Neutral Point Clamped Converter Using Deep Reinforcement Learning

A System Model-Based Optimal Composite Control for DC-DC Converters

State Space Average Modeling, Small Signal Analysis, and Control Implementation of an Efficient Single-Switch High-Gain Multicell Boost DC-DC Converter with Low Voltage Stress

Data-Driven Model-Free Adaptive Control of Z-Source Inverters

Energy-Based Switching Control for DC-DC Buck Converters with Switching Loads

State-Space Modeling, Design, and Analysis of the dc-dc Converters for PV Application: A Review

Optimized Control Method of Cascaded Bi-Directional DC-DC Converters