Abstract:Deep reinforcement learning (DRL) is an area of machine learning that combines a deep learning approach and reinforcement learning (RL). However, there seem to be few studies that analyze the latest DRL algorithms on real-world powertrain control problems. Meanwhile, the boost control of a variable geometry turbocharger (VGT)-equipped diesel engine is difficult mainly due to its strong coupling with an exhaust gas recirculation (EGR) system and large lag, resulting from time delay and hysteresis between the input and output dynamics of the engine’s gas exchange system. In this context, one of the latest model-free DRL algorithms, the deep deterministic policy gradient (DDPG) algorithm, was built in this paper to develop and finally form a strategy to track the target boost pressure under transient driving cycles. Using a fine-tuned proportion integration differentiation (PID) controller as a benchmark, the results show that the control performance based on the proposed DDPG algorithm can achieve a good transient control performance from scratch by autonomously learning the interaction with the environment, without relying on model supervision or complete environment models. In addition, the proposed strategy is able to adapt to the changing environment and hardware aging over time by adaptively tuning the algorithm in a self-learning manner on-line, making it attractive to real plant control problems whose system consistency may not be strictly guaranteed and whose environment may change over time.

Transient Controller Design Based on Reinforcement Learning for a Turbofan Engine with Actuator Dynamics

Design of Model Predictive Controller for Commercial Turbofan Engine

Fixed Dynamic Method for Transient-state Optimal Control Law Design of Aircraft Engine

An adaptive model predictive controller for turbofan engines

Tube-Based Model Predictive Control for Aero-Engine Transient-State Tracking Problems

An Integrated Controller Design for a Small Aero-Engine

Transient State Control of Aero-Engine Based on Active Disturbance Rejection Control

Intelligent Control Strategy for Transient Response of a Variable Geometry Turbocharger System Based on Deep Reinforcement Learning

A Frequency Domain Decoupling Method and Multivariable Controller Design for Turbofan Engines.

Design and Simulation of Aero-Engine Steady-State and Transient-State Control Integration

Networked guaranteed cost control for turbofan aero-engines

The Nonlinear Single Controller Of Dgen380 Aero Engine Design

Multivariable Constrained Predictive Control and Its Application to A Commercial Turbofan Engine

Design of time-delay robust cascade PI controller for turboshaft engine

System identification of a turbofan engine and design of its controller

A New Method for Designing Optimal Control Law of Aeroengine in Transient States

Networked Control System Design for Turbofan Aeroengines with Aging and Deterioration

Aeroengine Robust Gain-Scheduling Control Based on Performance Degradation

Thrust Estimation, Control, and Evaluation for Turbofan Engines

Design of Variable Weight SDRE Control Algorithm for Civil Aeroengine Transition State

A New Method for the Design of Optimal Control in the Transient State of a Gas Turbine Engine