Abstract:The organic Rankine cycle (ORC) is a promising technology for engine waste heat recovery. During real-world operation, the engine working condition varies frequently to satisfy the power demand; thus, the transient nature of engine waste heat presents significant control challenges for the ORC. To control the superheat of the ORC precisely under a transient heat source, several optimal control methods have been used such as model predictive control and dynamic programing. However, most of them depend strongly on the accurate prediction of future disturbances. Deep reinforcement learning (DRL) is an artificial-intelligence algorithm that can overcome the aforementioned disadvantage, but the potential of DRL in control of thermodynamic systems has not yet been investigated. Thus, this paper proposes two DRL-based control methods for controlling the superheat of ORC under a transient heat source. One directly uses the DRL agent to learn the control strategy (DRL control), and the other uses the DRL agent to optimize the parameters of the proportional-integral-derivative (PID) controller (DRL-based PID control). Additionally, a switching mechanism between different DRL controllers is proposed for improving the training efficiency and enlarging the operation range of the controller. The results of this study indicate that the DRL agent can satisfactorily perform the control task and optimize the traditional controller under the trained and untrained transient heat source. Specifically, the DRL control can track the reference superheat with an average error of only 0.19 K, whereas that of the traditional PID control is 2.16 K. Furthermore, the proposed switching DRL control exhibits excellent tracking performance with an average error of only 0.21 K and robustness over a wide range of operation conditions. The successful application of DRL demonstrates its considerable potential for the control of thermodynamic systems, providing a useful reference and motivation for the application to other thermodynamic systems.

Data-Driven Superheating Control of Organic Rankine Cycle Processes

Simultaneous Optimization for Organic Rankine Cycle Design and Heat Integration

Integrated Operation Design and Control of Organic Rankine Cycle Systems with Disturbances

Optimization of Organic Rankine Cycle Involving Operating Conditions and Work Fluids and Heat Integration

Simultaneous Optimization of a Heat Exchanger Network and Operating Conditions of Organic Rankine Cycle

Fast Economic Nonlinear Model Predictive Control Strategy of Organic Rankine Cycle for Waste Heat Recovery: Simulation-based Studies

Multi-Objective Optimal Temperature Control for Organic Rankine Cycle Systems

Constrained Entropy-Based Temperature Control of Waste Heat Systems

Dynamic Analysis and Control Strategies of Organic Rankine Cycle System for Waste Heat Recovery Using Zeotropic Mixture As Working Fluid

Modified hierarchical strategy for transient performance improvement of the ORC based waste heat recovery system

Control Of Organic Rankine Cycle For Waste Heat Recovery Based On An Optimized Predictive Model

Data-driven Identification and Fast Model Predictive Control of the ORC Waste Heat Recovery System by Using Koopman Operator

Process Integration and Superstructure Optimization of Organic Rankine Cycles (orcs) with Heat Exchanger Network Synthesis

Neuro-PID Control of Heat Exchanger in an Organic Rankine Cycle System for Waste Heat Recovery

Superstructure-based mixed-integer nonlinear programming framework for hybrid heat sources driven organic Rankine cycle optimization

A Synergistic Multi-Objective Optimization Mixed Nonlinear Dynamic Modeling Approach for Organic Rankine Cycle (ORC) under Driving Cycle

Control of Superheat of Organic Rankine Cycle under Transient Heat Source Based on Deep Reinforcement Learning

Dynamic behaviour and performance evaluation of a biomass-fired organic Rankine cycle combined heat and power (ORC-CHP) system under different control strategies

Generalized Correntropy Predictive Control for Waste Heat Recovery Systems Based on Organic Rankine Cycle.

Dynamic Modeling and Comparison Study of Control Strategies of a Small-Scale Organic Rankine Cycle

The Energy Flow Method for Modeling and Optimization of Organic Rankine Cycle (ORC) Systems