Abstract:In proton exchange membrane fuel cells (PEMFCs), the hydrogen supply system and air supply system jointly impact the output characteristics, and there is a coordination problem between these two systems. To solve this coordination problem, an intelligent control framework is presented that considers the coordination between the air flux controller and hydrogen flux controller in PEMFCs, and an ensemble imitation learning multi-trick deep deterministic policy gradient (EILMMA-DDPG) is advanced for this framework. The algorithm proposed here complies with an ensemble imitation learning policy, i.e., exploiting multiple reinforcement learning explorers that contain actor networks to perform distributed exploration in the environment, thereby improving the exploration efficiency. Moreover, a control algorithm explorer that contains various conventional control algorithms is presented to create model samples over a range of scenarios in an attempt to address sparse rewards and improve the training efficiency in conjunction with an experience probability replay mechanism. Next, multiple tricks are adopted to improve the overestimated Q value. Finally, a model-free intelligent control algorithm capable of coordinating controllers and exhibiting a better global searching ability is developed. In addition, the proposed algorithm is adopted in the control framework of the air and hydrogen supply system in PEMFCs. Furthermore, as revealed from the simulated results, the proposed intelligent control framework can more effectively control the oxygen excess rate (OER) and output voltage.

A Novel Integral Reinforcement Learning-Based H ∞ Control Strategy for Proton Exchange Membrane Fuel Cell in DC Microgrids

A Novel Adaptive Model Predictive Control for Proton Exchange Membrane Fuel Cell in DC Microgrids

A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid

Multi-objective optimal control for proton exchange membrane fuel cell via large-scale deep reinforcement learning

Adaptive Controller of PEMFC Output Voltage Based on Ambient Intelligence Large-Scale Deep Reinforcement Learning

Temperature Control of Fuel Cell Based on PEI-DDPG

Distributed deep reinforcement learning for optimal voltage control of PEMFC

Intelligent Controller Based on Distributed Deep Reinforcement Learning for PEMFC Air Supply System

A new adaptive controller based on distributed deep reinforcement learning for PEMFC air supply system

Data-Driven Control for Proton Exchange Membrane Fuel Cells: Method and Application

Data-driven coordinated control method for multiple systems in proton exchange membrane fuel cells using deep reinforcement learning

Deep Reinforcement Learning Algorithm Based on Fusion Optimization for Fuel Cell Gas Supply System Control

Active Control Strategy Based on Vector-Proportion Integration Controller for Proton Exchange Membrane Fuel Cell Grid-Connected System

A critical survey of proton exchange membrane fuel cell system control: Summaries, advances, and perspectives

Distributed Imitation-Orientated Deep Reinforcement Learning Method for Optimal PEMFC Output Voltage Control

Sensors Integrated Control of PEMFC Gas Supply System Based on Large-Scale Deep Reinforcement Learning

Coordinated control of gas supply system in PEMFC based on multi-agent deep reinforcement learning

A Large-Scale Multi-Agent Deep Reinforcement Learning Method for Cooperative Output Voltage Control of PEMFCs

Adaptive Control of Oxygen Excess Ratio in a Proton Exchange Membrane Fuel Cell System

Temperature Control of Proton Exchange Membrane Fuel Cell Based on Machine Learning

Modeling and Control of Air Stream and Hydrogen Flow with Recirculation in a PEM Fuel Cell System—ii. Linear and Adaptive Nonlinear Control