Abstract:Solid oxide fuel cells (SOFC) are complex nonlinear and time-varying systems with operational constraints. How to effectively control and stabilize the output voltage while preventing constraint violations becomes a main challenge to its wide application. To improve the efficiency of its operation and power tracking control and prevent constraint violations, this paper designs a data-driven adaptive proportional integral derivative (PID) controller, which maintains the output voltage at the reference value via the optimal control of the hydrogen flow. Moreover, a novel large-scale deep reinforcement learning (DRL) algorithm, called the two-stage training strategy large-scale twin delayed deep determination policy gradient (TGSL-TD3PG), is adopted to adaptively adjust the baseline coefficients of the designed controller scaffolded by the high adaptability and model-free features of reinforcement learning. In the training of TGSL-TD3PG, multiple agents are simultaneously employed to acquire the best policy, whereby the training of optimal agents in practice is structured upon the principles of imitation learning and curriculum learning. This method solves the common problem of low robustness in conventional deep reinforcement learning and can be applied to the field of control. Moreover, the TGSL-TD3PG algorithm incorporates the baseline PID coefficients into the design objective and offers the controller with the online coefficient-adjusting ability through learning. Therefore, such limitations as no adaptability, low robustness and neglect of constraints associated with conventional PID control are significantly addressed. Simulation results show that the proposed controller can promote the SOFC to track the load power demand effectively while maintaining the fuel utilization ratio constant. The proposed algorithm reduces 45.2% of the output voltage setting time and 30% of the voltage overshoot to the maximum extent, while generating the constraint violation time of fuel utilization at 0.

Iterative Learning Control of Methane Steam Reforming Reaction in Operating Solid Oxide Fuel Cell

Multi-objective Optimizations of Solid Oxide Co-Electrolysis with Intermittent Renewable Power Supply Via Multi-Physics Simulation and Deep Learning Strategy

Iterative Learning Control of SOFC Based on ARX Identification Model

A novel data-driven controller for solid oxide fuel cell via deep reinforcement learning

Optimal adaptive control for solid oxide fuel cell with operating constraints via large-scale deep reinforcement learning

Optimal dual-model controller of solid oxide fuel cell output voltage using imitation distributed deep reinforcement learning

Thermal Modeling and Management of Solid Oxide Fuel Cells Operating with Internally Reformed Methane

Control Loop Design and Control Performance Study on Direct Internal Reforming Solid Oxide Fuel Cell

Modeling and evaluating of thermo-electro-chemo-mechanical behavior for pre-reformed methane-fueled solid oxide fuel cell

Control Strategy Research of Direct Internal Reforming Solid Oxide Fuel Cell

Coupling deep learning and multi-objective genetic algorithms to achieve high performance and durability of direct internal reforming solid oxide fuel cell

Nonlinear Model Predictive Control Based on the Moving Horizon State Estimation for the Solid Oxide Fuel Cell

A Practical Compound Controller Design for Solid Oxide Fuel Cells

Temperature Control of A Sofc and Mgt Hybrid System

Feedforward and Desired Dynamic Equation Control for Solid Oxide Fuel Cell System.

Nonlinear model predictive control of direct internal reforming solid oxide fuel cells via PDAE-constrained dynamic optimization

One-dimensional Dynamic Modeling and Simulation of a Planar Direct Internal Reforming Solid Oxide Fuel Cell

A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid

Predictive Control of a Direct Internal Reforming SOFC Using a Self Recurrent Wavelet Network Model

Optimization of Methane Reforming for High Efficiency and Stable Operation of SOFC Stacks

Multiple model predictive control for solid oxide fuel cells