Abstract:Solid oxide fuel cells (SOFC) are complex nonlinear and time-varying systems with operational constraints. How to effectively control and stabilize the output voltage while preventing constraint violations becomes a main challenge to its wide application. To improve the efficiency of its operation and power tracking control and prevent constraint violations, this paper designs a data-driven adaptive proportional integral derivative (PID) controller, which maintains the output voltage at the reference value via the optimal control of the hydrogen flow. Moreover, a novel large-scale deep reinforcement learning (DRL) algorithm, called the two-stage training strategy large-scale twin delayed deep determination policy gradient (TGSL-TD3PG), is adopted to adaptively adjust the baseline coefficients of the designed controller scaffolded by the high adaptability and model-free features of reinforcement learning. In the training of TGSL-TD3PG, multiple agents are simultaneously employed to acquire the best policy, whereby the training of optimal agents in practice is structured upon the principles of imitation learning and curriculum learning. This method solves the common problem of low robustness in conventional deep reinforcement learning and can be applied to the field of control. Moreover, the TGSL-TD3PG algorithm incorporates the baseline PID coefficients into the design objective and offers the controller with the online coefficient-adjusting ability through learning. Therefore, such limitations as no adaptability, low robustness and neglect of constraints associated with conventional PID control are significantly addressed. Simulation results show that the proposed controller can promote the SOFC to track the load power demand effectively while maintaining the fuel utilization ratio constant. The proposed algorithm reduces 45.2% of the output voltage setting time and 30% of the voltage overshoot to the maximum extent, while generating the constraint violation time of fuel utilization at 0.

Distributed Imitation-Orientated Deep Reinforcement Learning Method for Optimal PEMFC Output Voltage Control

Distributed deep reinforcement learning for optimal voltage control of PEMFC

A Large-Scale Multi-Agent Deep Reinforcement Learning Method for Cooperative Output Voltage Control of PEMFCs

Control Method for PEMFC Using Improved Deep Deterministic Policy Gradient Algorithm

Multi-objective optimal control for proton exchange membrane fuel cell via large-scale deep reinforcement learning

Adaptive Controller of PEMFC Output Voltage Based on Ambient Intelligence Large-Scale Deep Reinforcement Learning

Intelligent Controller Based on Distributed Deep Reinforcement Learning for PEMFC Air Supply System

Optimal dual-model controller of solid oxide fuel cell output voltage using imitation distributed deep reinforcement learning

A new adaptive controller based on distributed deep reinforcement learning for PEMFC air supply system

Data-driven coordinated control method for multiple systems in proton exchange membrane fuel cells using deep reinforcement learning

Data‐driven optimal PEMFC temperature control via curriculum guidance strategy‐based large‐scale deep reinforcement learning

Data-Driven Control for Proton Exchange Membrane Fuel Cells: Method and Application

Sensors Integrated Control of PEMFC Gas Supply System Based on Large-Scale Deep Reinforcement Learning

Temperature Control of Proton Exchange Membrane Fuel Cell Based on Machine Learning

Temperature Control of Fuel Cell Based on PEI-DDPG

Coordinated control of gas supply system in PEMFC based on multi-agent deep reinforcement learning

A novel data-driven controller for solid oxide fuel cell via deep reinforcement learning

A data-driven output voltage control of solid oxide fuel cell using multi-agent deep reinforcement learning

Large-scale multi-agent deep reinforcement learning-based coordination strategy for energy optimization and control of proton exchange membrane fuel cell

Distributed deep reinforcement learning-based coordination performance optimization method for proton exchange membrane fuel cell system

A Novel Integral Reinforcement Learning-Based H ∞ Control Strategy for Proton Exchange Membrane Fuel Cell in DC Microgrids