Abstract:Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, Ahead of Print. A deep reinforcement learning application is investigated to control the emissions of a compression ignition diesel engine. The main purpose of this study is to reduce the engine-out nitrogen oxide [math] emissions and to minimize fuel consumption while tracking a reference engine load. First, a physics-based engine simulation model is developed in GT-Power and calibrated using experimental data. Using this model and a GT-Power/Simulink co-simulation, a deep deterministic policy gradient is developed. To reduce the risk of an unwanted output, a safety filter is added to the deep reinforcement learning. Based on the simulation results, this filter has no effect on the final trained deep reinforcement learning; however, during the training process, it is crucial to enforce constraints on the controller output. The developed safe reinforcement learning is then compared with an iterative learning controller and a deep neural network–based nonlinear model predictive controller. This comparison shows that the safe reinforcement learning is capable of accurately tracking an arbitrary reference input while the iterative learning controller is limited to a repetitive reference. The comparison between the nonlinear model predictive control and reinforcement learning indicates that for this case reinforcement learning is able to learn the optimal control output directly from the experiment without the need for a model. However, to enforce output constraint for safe learning reinforcement learning, a simple model of system is required. In this work, reinforcement learning was able to reduce [math] emissions more than the nonlinear model predictive control; however, it suffered from slightly higher error in load tracking and a higher fuel consumption.

Intelligent Control of Aeroengines Based on Safe Deep Reinforcement Learning

An Integrated Controller Design for a Small Aero-Engine

Acceleration control strategy for aero-engines based on model-free deep reinforcement learning method

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

The Nonlinear Single Controller Of Dgen380 Aero Engine Design

A Study of Aero-Engine Control Method Based on Deep Reinforcement Learning.

Design of Variable Weight SDRE Control Algorithm for Civil Aeroengine Transition State

Learning-Based Neural Dynamic Surface Predictive Control for MMC

An Aero-Engine U-control Method Based on LPV Model

Wide-range model predictive control for aero-engine transient state

Deep reinforcement learning based active surge control for aeroengine compressors

Adaptive and Learning Control for SI Engine Model With Uncertainties

A Research on Aero-engine Control Based on Deep Q Learning

Online Safe Flight Control Method Based on Constraint Reinforcement Learning

Tracking Controller Design for Aero-Engine Based on Improved Multi-Power Reaching Law of Sliding Mode Control

Nonlinear Design Method for Improving Aero-Engine Control Performance

A Domain-Knowledge-Aided Deep Reinforcement Learning Approach for Flight Control Design

Safe deep reinforcement learning in diesel engine emission control

Safe reward‐based deep reinforcement learning control for an electro‐hydraulic servo system

LMI-based Aero-Engine Condition Feedback Optimal Control

Adaptive Two-Degree-of-Freedom Robust Gain-Scheduling Control Strategy