Abstract:Solid oxide fuel cells (SOFC) are complex nonlinear and time-varying systems with operational constraints. How to effectively control and stabilize the output voltage while preventing constraint violations becomes a main challenge to its wide application. To improve the efficiency of its operation and power tracking control and prevent constraint violations, this paper designs a data-driven adaptive proportional integral derivative (PID) controller, which maintains the output voltage at the reference value via the optimal control of the hydrogen flow. Moreover, a novel large-scale deep reinforcement learning (DRL) algorithm, called the two-stage training strategy large-scale twin delayed deep determination policy gradient (TGSL-TD3PG), is adopted to adaptively adjust the baseline coefficients of the designed controller scaffolded by the high adaptability and model-free features of reinforcement learning. In the training of TGSL-TD3PG, multiple agents are simultaneously employed to acquire the best policy, whereby the training of optimal agents in practice is structured upon the principles of imitation learning and curriculum learning. This method solves the common problem of low robustness in conventional deep reinforcement learning and can be applied to the field of control. Moreover, the TGSL-TD3PG algorithm incorporates the baseline PID coefficients into the design objective and offers the controller with the online coefficient-adjusting ability through learning. Therefore, such limitations as no adaptability, low robustness and neglect of constraints associated with conventional PID control are significantly addressed. Simulation results show that the proposed controller can promote the SOFC to track the load power demand effectively while maintaining the fuel utilization ratio constant. The proposed algorithm reduces 45.2% of the output voltage setting time and 30% of the voltage overshoot to the maximum extent, while generating the constraint violation time of fuel utilization at 0.

A novel data-driven controller for solid oxide fuel cell via deep reinforcement learning

Optimal adaptive control for solid oxide fuel cell with operating constraints via large-scale deep reinforcement learning

A data-driven output voltage control of solid oxide fuel cell using multi-agent deep reinforcement learning

Optimal dual-model controller of solid oxide fuel cell output voltage using imitation distributed deep reinforcement learning

A Policy optimization-based Deep Reinforcement Learning method for data-driven output voltage control of grid connected solid oxide fuel cell considering operation constraints

A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid

A Reinforcement Learning-Based Temperature Control of Fluidized Bed Reactor in Gas-Phase Polyethylene Process

Multi-objective Optimizations of Solid Oxide Co-Electrolysis with Intermittent Renewable Power Supply Via Multi-Physics Simulation and Deep Learning Strategy

Multi-objective optimal control for proton exchange membrane fuel cell via large-scale deep reinforcement learning

Feedforward and Desired Dynamic Equation Control for Solid Oxide Fuel Cell System.

Multiple model predictive control for solid oxide fuel cells

A Practical Compound Controller Design for Solid Oxide Fuel Cells

Voltage and Fuel Utilization Control Strategy for Solid Oxide Fuel Cell Based on Active Disturbance Rejection Control

Distributed deep reinforcement learning-based gas supply system coordination management method for solid oxide fuel cell

A multi-objective energy coordinative and management policy for solid oxide fuel cell using triune brain large-scale multi-agent deep deterministic policy gradient

A Multi-loop Control Strategy for 5 Kw Solid Oxide Fuel Cell Hybrid System

Distributed deep reinforcement learning for optimal voltage control of PEMFC

Nonlinear model predictive control of direct internal reforming solid oxide fuel cells via PDAE-constrained dynamic optimization

Distributed Imitation-Orientated Deep Reinforcement Learning Method for Optimal PEMFC Output Voltage Control

A new adaptive controller based on distributed deep reinforcement learning for PEMFC air supply system

Data‐driven optimal PEMFC temperature control via curriculum guidance strategy‐based large‐scale deep reinforcement learning