APPLICATION OF ITERATIVE DYNAMIC PROGRAMMING TO DYNAMIC OPTIMIZATION PROBLEMS

Jing Song,Zhu'an Cao

DOI: https://doi.org/10.3321/j.issn:0438-1157.1999.01.018

1999-01-01

Abstract:The basic idea and the structure of Iterative Dynamic Programming algorithm are studied. This method is applied to practical examples of chemical engineering production, and the performance of IDP is tested.

What problem does this paper attempt to address?

Dynamic Optimization for Chemical Process Based on Improved Iterative Dynamic Programming Algorithm

PAN Yan,FEI Zheng-shun,ZHAO Li,LIANG Jun

DOI: https://doi.org/10.3969/j.issn.1006-3080.2013.01.011

2013-01-01

Abstract:To get the global optimization of chemical engineering dynamic system rapidly,an improved iterative dynamic programming algorithm based on first order algorithm was proposed.This algorithm used both stochastic search and deterministic search,which combined the advantages of iterative dynamic programming algorithm and first order gradient algorithm.Then the algorithm was applied to two practical examples of chemical producing.The results proved that the algorithm had advantages of precision,high efficiency and global optimization.
An approach to iterative dynamic programming for batch reactor systems

Liu Xinggao,Wu Gaohui

DOI: https://doi.org/10.3969/j.issn.1001-4160.2008.07.006

2008-01-01

Abstract:With the requirement of reducing in production costs,improving product quality,safety and environmental regulations in in- dustrial process,dynamic optimization of batch reactor has attracted attention in recent decades.An efficient iterative dynamic program- ming(IDP)approach of batch reactor is therefore explored based on random admissible values,and the detailed procedures of the presented approach are then given,which can efficiently achieve the dynamic optimization of variables(temperature,concentration, etc.)in the batch reaction processes,and avoid the problem of proliferating in the computational time by adjusting the number of sub- section P and discrete points(N and M)simultaneously.Moreover,it is reliable and easy to find global optimum of the model.A clas- sical dynamic optimization problem in the batch reactor is then carried out as a illustration example.The detailed comparative research with the results reported in the open literatures is further carried out.The research's results proved the efficiency of the presented ap- proach.
Production Optimization for Concentration and Volume-Limited Fed-Batch Reactors in Biochemical Processes

Ping Liu,Xinggao Liu,Zeyin Zhang,Yalin Wang,Chunhua Yang,Weihua Gui

DOI: https://doi.org/10.1007/s00449-017-1875-y

IF: 3.434

2018-01-01

Bioprocess and Biosystems Engineering

Abstract:Since a very slight violation of constraint could cause process safety and product quality problems in biochemical processes, an adaptive approach of fed-batch reactor production optimization that can strictly satisfy constraints over the entire operating time is presented. In this approach, an improved smooth function is proposed such that the inequality constraints can be transformed into smooth constraints. Based on this, only an auxiliary state is needed to monitor violations in the augmented performance index. Combined with control variable parameterization (CVP), the dynamic optimization is executed and constraint violations are examined by calculating the sensitivities of states to ensure that the inequality constraints are satisfied everywhere inside the time interval. Three biochemical production optimization problems, including the manufacturing of ethanol, penicillin and protein, are tested as illustrations. Meanwhile, comparisons with pure penalty CVP method, famous dynamic optimization toolbox DOTcvp and literature results are carried out. Research results show that the proposed method achieves better performances in terms of optimization accuracy and computation cost.
An Improved Quasi-Sequential Approach To Large-Scale Dynamic Process Optimization

Weirong Hong,Pengcheng Tan,Quoc Dong Vu,Pu Li

DOI: https://doi.org/10.1016/S1570-7946(09)70262-7

2009-01-01

Abstract:We present an improved quasi-sequential approach to large-scale dynamic process optimization. This new approach incorporates the quasi-sequential approach with the interior point method to handle inequality constraints. In this way the eventual optimization problem to be solved becomes a NLP without constraints. Mathematical derivations and computation schemes are developed. We first take a two-dimensional constrained optimization problem as an example; the result is compared with the simultaneous and quasi-sequential approach in terms of path solution with a graphical interpretation. A highly nonlinear reactor optimal control problem is also taken to demonstrate the effectiveness of this approach.
Chemical Process Optimization Approach Based on Primal-Dual Interior-Point Method

HONG Weirong,WANG Yan,TAN Pengcheng

2010-01-01

Abstract:Based on active set SQP quasi-sequential approach,a quasi-sequential approach based on primal-dual interior-point method was presented.Quasi-sequential approach included two layers called simulation layer and optimization layer.In the simulation layer orthogonal collocation method was used to discretize both state variables and control variables,and the discretized DAE system was solved at each NLP iteration to eliminate equality constraints and state variables,so that the optimization problem is reduced to a smaller NLP problem only with inequality constraints and control variables.Recent studies showed that interior-point method took advantage of active set method in large-scale optimization problems,thus in the optimization layer a primal-dual interior-point method is employed.FORTRAN is used to code quasi-sequential approach and a distillation optimal control problem is optimized to demonstrate the efficiency.Results show that this approach has the capacity to solve large-scale dynamic optimization problems.
Optimization in Process Industries and Its Application

ZHU Xue-mei,WANG Shu-qing,YUE Dong

2006-01-01

Abstract:Process optimization plays an important role in design,operation,control and computer(integrated) control of process industries.This paper presents the description of steady-state optimization,(dynamic) optimization,and the optimization of process structures based on changing market conditions in(process) industries.Characteristics of these optimization problems are addressed and state of the art solution approaches are proposed.Sequential quadratic programming and orthogonal collocation is used to solve the dynamic optimization problem.Finally,the dynamic optimization to minimize the energy cost of a heatintegrated distillation column system is illustrated as an example.
A quasi-sequential approach to large-scale dynamic optimization problems

Weirong Hong,Shuqing Wang,Pu Li,Günter Wozny,Lorenz T. Biegler

DOI: https://doi.org/10.1002/aic.10625

IF: 4.167

2006-01-01

AIChE Journal

Abstract:A novel sequential approach for solving dynamic optimization problems containing path constraints on state variables is presented and its performance analyzed. As in the simultaneous approach, we discretize both state and control variables using collocation on finite elements, so that path constraints can be guaranteed inside each element. The state variables are solved in a manner similar to that in the sequential approach; this eliminates the discretized differential-algebraic equations and state variables, so that the problem is reduced to a smaller problem only with inequality constraints and control variables. Therefore, it possesses advantages of both the simultaneous and the sequential approach. Furthermore, the elimination of the equality constraints substantially simplifies the line search problem and thus larger steps can be taken by successive quadratic programming (SQP) toward the optimum. We call this dynamic optimization method a quasi-sequential approach. We compare this new approach with the simultaneous approach in terms of computational cost and by analyzing the solution path. A highly nonlinear reactor control and the optimal operation of a heat-integrated column system are used to demonstrate the effectiveness of this approach. As a result, it can be concluded that this quasi-sequential approach is well suited for solving highly nonlinear large-scale optimal control problems. (c) 2005 American Institute of Chemical Engineers.
An Effective Simultaneous Approach with Variable Time Nodes for Dynamic Optimization Problems

Long Xiao,Jiong Ying,Xinggao Liu,Liang Ma

DOI: https://doi.org/10.1080/0305215x.2016.1270276

IF: 2.5

2017-01-01

Engineering Optimization

Abstract:An effective simultaneous approach with variable time nodes is proposed to solve the dynamic optimization problems with multiple control components, where the variable time nodes for each control component are considered as parameters directly and the interval between the neighbouring variable nodes is further refined uniformly to ensure accuracy. Consequently, the method does not treat all the nodes as parameters to ensure efficiency. The gradient formulae and the sensitivities of the states with respect to the controls and the variable time nodes are further derived to solve the nonlinear programming problem transformed from the original dynamic optimization problem. The complete framework and detailed steps of the proposed method are also given. Two classic constrained dynamic optimization problems have been tested as an illustration, and detailed comparisons of the reported literature methods are carried out. The research results show the characteristics and the effectiveness of the proposed approach.
NEURAL NETWORK BASED ON-LINE RE-OPTIMISATION OF FED-BATCH PROCESSES USING ITERATIVE DYNAMIC PROGRAMMING FOR DISCRETE-TIME SYSTEMS

Zhihua Xiong,Jie Zhang

DOI: https://doi.org/10.3182/20020721-6-es-1901.01357

2002-01-01

IFAC Proceedings Volumes

Abstract:Optimisation of fed-batch processes can be described as a constrained nonlinear end-point dynamic optimisation problem. Although iterative dynamic programming (IDP) is feasible, it is usually very time-consuming and very difficult to apply to on-line optimisation because of solving the non-linear differential-algebraic equations of the process model in each iteration. The replacement of a rigorous mechanistic model by an equivalent neural network (NN) model takes the advantage of high speed processing, since simulation with a NN model involves only a few non-iterative algebraic calculations. To use IDP algorithm for NN model based on-line re-optimisation, a modified algorithm is proposed and is called as iterative dynamic programming for discrete-time system (IDP/DTS). The novel IDP/DTS algorithm can obtain a reduction of many times in computational time compared to the conventional IDP algorithm. In this paper, an effective optimisation and control scheme for on-line re-optimisation of fed-batch processes is proposed based on NN models and the novel IDP/DTS algorithm. The proposed scheme is illustrated using simulation studies of an ethanol fermentation process.
Object-Oriented Disjunctive Programming with a Nested Heuristic and Gradient-Based Solver for Chemical Process Synthesis

Daqing Tian,Lingyu Zhu,Xi Chen,Zhijiang Shao,Jixin Qian

DOI: https://doi.org/10.1021/ie901010a

2010-01-01

Industrial & Engineering Chemistry Research

Abstract:The generalized disjunctive programming (GDP) model has been proposed and applied in the past decade as an alternative to the mixed integer nonlinear programming (MINLP) model because it has the advantages of being straightforward when used in conditional modeling and being able to reduce the complexity in the sub-NLP. In this paper, we introduced an improved variant of the traditional GDP model, otherwise known as the object-oriented disjunctive programming (ODP) model. Such a method helps generate well-posed sub-NLP, thereby improving the solving process. A nested method combining the heuristic algorithm and gradient-based optimizer is also proposed to solve the GDP and ODP. It is a two-layer method, wherein a heuristic algorithm performs master iterations in the outer-loop when dealing with the Boolean variables, and a gradient-based NLP solver is applied in the inner-loop when dealing with the sub-NLP. Excellent performance has been demonstrated by applying the modeling and solving methods into the process synthesis of heat exchanger networks (HENs) and water networks (WNs).
A Bilevel NLP Sensitivity‐based Decomposition for Dynamic Optimization with Moving Finite Elements

Weifeng Chen,Zhijiang Shao,Lorenz T. Biegler

DOI: https://doi.org/10.1002/aic.14339

IF: 4.167

2014-01-01

AIChE Journal

Abstract:Optimal control has guided numerous applications in chemical engineering, and exact determination of optimal profiles is essential for operation of separation and reactive processes, and operating strategies and recipe generation for batch processes. Here, a simultaneous collocation formulation based on moving finite elements is developed for the solution of a class of optimal control problems. Novel features of the algorithm include the direct location of breakpoints for control profiles and a termination criterion based on a constant Hamiltonian profile. The algorithm is stabilized and performance is significantly improved by decomposing the overall nonlinear programming (NLP) formulation into an inner problem, which solves a fixed element simultaneous collocation problem, and an outer problem, which adjusts the finite elements based on several error criteria. This bilevel formulation is aided by a NLP solver (the interior point optimizer) for both problems as well as an NLP sensitivity component, which provides derivative information from the inner problem to the outer problem. This approach is demonstrated on 11 dynamic optimization problems drawn from the optimal control and chemical engineering literature. © 2014 American Institute of Chemical Engineers AIChE J, 60: 966–979, 2014
Optimization Model for Production Planning Based on Dynamic Programming

LIU Li-jun,WU Da-sheng,Li-jun Liu,Da-sheng Wu

DOI: https://doi.org/10.1109/aici.2009.111

2009-01-01

Abstract:Dynamic programming is a branch of operations research. It is a process of multi-stage decision which can be used to solve problems of multi-objective decision to achieve the optimal results. Take the case of optimizing the arrangement of production planning on an enterprise, it has established arrangements model of production planning by using dynamic programming methods under constraint conditions such as production capacity, production costs and inventory costs etc. of the enterprise. Meanwhile, it has solved the problems of optimization for production planning of the products through model solution and has achieved the corresponding procedures by c + + programming language.
Dynamic programming in tasks of optimization of material properties

P. L.,N. S.,I. A.,Guo-yi TANG

DOI: https://doi.org/10.3969/j.issn.1007-791X.2011.06.008

2011-01-01

Abstract:The complex method of dynamic programming is developed in the conditions of uncertainty allowing to search for optimal the control trajectories of nonstationary dynamic objects of a complex structure specified for tasks in material science.For this purpose,by the use of an unknown mathematical model,a procedure of evolution planning is unified with a method of dynamic programming and complex nonstationary objects.The developed complex method is applied to solve the problem of finding optimal parameters involved in the current treatments upon the crystallization of alloyed iron melts in the casting mold.
Dynamic Optimization of Multivariable Endothermic Reaction in Cascade CSTR

Yang Chen,Zhijiang Shao,Jixin Qian,Kexin Wang,Zhiliang Zhan,Zuhua Xu

DOI: https://doi.org/10.1109/wcica.2010.5553780

2010-01-01

Abstract:The dynamic optimization problem of a multivariable endothermic reaction in cascade continuous stirred tank reactors is solved with simultaneous method in this paper. Radau collocation is applied in discretization because of its stiff decay and high precision. A two-layer optimization is presented to get a fast convergence rate when dealing with the nonlinear case. In the industry process, the load variation may be very large and may cause output variable's big overshoot. In order to reduce the overshoot, a segmentation load variation method is introduced. The good results of this nonlinear ordinary differential equations system show the validity of these methods.
Applying Analytical Derivative and Sparse Matrix Techniques to Large-Scale Process Optimization Problems

WT Zhong,ZJ Shao,YY Zhang,JX Qian

2000-01-01

Abstract:The performance of analytical derivative and sparse matrix techniques applied to a traditional dense sequential quadratic programming (SQP) is studied, and the strategy utilizing those techniques is also presented. Computational. results on two typical chemical optimization problems demonstrate significant enhancement in efficiency, which shows this strategy is promising and suitable for large-scale process optimization problems.
A Three-section Algorithm of Dynamic Programming Based on Three-stage Decomposition System Model for Grade Transition Trajectory Optimization Problems

Yujie Wei,Yongheng Jiang,Dexian Huang

DOI: https://doi.org/10.1016/j.cjche.2014.09.002

2014-01-01

Abstract:This paper introduces a practical solving scheme of gradetransition trajectory optimization (GTTO) problems under typical certificate-checking–updating framework. Due to complicated kinetics of polymerization, differential/algebraic equations (DAEs) always cause great computational burden and system non-linearity usually makes GTTO non-convex bearing multiple optima. Therefore, coupled with the three-stage decomposition model, a three-section algorithm of dynamic programming (TSDP) is proposed based on the general iteration mechanism of iterative programming (IDP) and incorporated with adaptivegrid allocation scheme and heuristic modifications. The algorithm iteratively performs dynamic programming with heuristic modifications under constant calculation loads and adaptively allocates the valued computational resources to the regions that can further improve the optimality under the guidance of local error estimates. TSDP is finally compared with IDP and interior point method (IP) to verify its efficiency of computation.
Distributed Dynamic Optimization for Chemical Process Networks Based on Differential Games

Qiang Zhu,Kexin Wang,Zhijiang Shao,Lorenz T. Biegler

DOI: https://doi.org/10.1021/acs.iecr.9b04663

2019-01-01

Industrial & Engineering Chemistry Research

Abstract:Two distributed dynamic optimization structures, receding noncooperative game optimization (RNGO) and receding cooperative game optimization (RCGO), are presented for analyzing distributed dynamic optimization for chemical process networks. Moreover, to solve these distributed differential game optimization problems, we introduce an iterative decomposition method (IDM). System stability and robustness under RNGO and RCGO structures are also analyzed. RNGO and RCGO structures and IDM are utilized to address distributed dynamic optimization for a chemical process recycle network, consisting of two continuous stirred tank reactors and a nonadiabatic flash. Economic, closed-loop dynamic, and real-time performance indices are evaluated for each structure and compared with those of the receding centralized optimization (RCO). We conclude that RNGO and RCGO can effectively solve distributed dynamic optimization for chemical process networks. Moreover, robust stability under these structures is guaranteed, and RCGO shows significant advantages in solving dynamic optimization problems for chemical process networks.
Optimizing Operations Management and Business Analytics Strategies under Uncertainty: Dynamic Programming

Ran Yi

DOI: https://doi.org/10.54254/2754-1169/49/20230507

2023-12-01

Abstract:Dynamic programming is a method used in mathematics, management science, computer science, economics, and bioinformatics to solve complex problems by decomposing the original problem into relatively simple sub-problems. Dynamic programming is often applicable to problems with overlapping subproblems and optimal substructure properties. This paper employs a comprehensive research approach of literature review, as well as empirical analysis and case studies to investigate the topic and demonstrate the practicality and effectiveness of dynamic programming in solving complex decision-making problems. However, the curse of dimensionality poses challenges when dealing with high-dimensional decision spaces, requiring approximate dynamic programming methods, including reinforcement learning algorithms. Therefore, when dealing with more complex dynamic programming problems, it is also essential to use program construction tools such as Python to help design a program that can optimize the problem. Therefore, in the learning of dynamic programming, in addition to the correct understanding of basic concepts and methods, specific problems must be analyzed and dealt with in detail, models should be built with rich imagination, and solutions should be solved with creative skills.
Internal-growth Strategies for Dynamic Process Optimization with Differential-algebraic Equations

Zhiqiang Wang,Zhijiang Shao,Xueyi Fang,Jun Zhao,Zuhua Xu

DOI: https://doi.org/10.3182/20140824-6-za-1003.01811

2014-01-01

IFAC Proceedings Volumes

Abstract:Simultaneous methods based on numerical differentiation for process dynamic optimization are discussed, and succinct variants of the full discretized models, which are collocated by Lobatto methods, are proposed. With the same original dynamic problem, its discretized models with different number of finite elements have good structural similarity, and their optimal results can also fit well with each other. A novel solving idea is proposed that the low-density discretized solution is interpolated as the starting point for solving high-density discretized model, then the warm-start technology for the interior point method and the initial value setting method of barrier parameter are integrated to develop a fast solving strategy for dynamic optimization, named internal-growth approach. Finally, several test models, including the crystallization process optimization problem, are solved by the proposed approach, and the excellent solving efficiency is illustrated.
Nested Heuristic and Gradient-Based Method for Generalized Disjunctive Programming

Daqing Tian,Lingyu Zhu,Xi Chen,Zhijiang Shao,Jixin Qian

DOI: https://doi.org/10.1016/s1570-7946(09)70365-7

2009-01-01

Abstract:The Generalized Disjunctive Programming (GDP) has been proposed as an alternative to the mixed integer nonlinear programming (MINLP) for applications in process synthesis. It is straightforward in conditional modelling. Besides, it can reduce the complexity of the NLP sub-problems. In this paper, a nested method combining heuristic algorithm and gradient-based optimizer is proposed to solve the GDPs. It is generally a two-layer method, where the heuristic algorithm such as Tabu Search (TS) or Genetic Algorithm (GA) performs master iterations in the outer loop dealing with the logical variables of GDPs, and a gradient-based NLP solver such as Sequential Quadratic Programming (SQP) is applied in the inner layer dealing with the sub-NLP problems. In each call by the outer-layer heuristic algorithm, a set of logic values is specified and passed to the inner-layer. The general GDP model can thus be transformed into a reduced NLP sub-problem by automatically eliminating a number of equations based on the logic disjunction, nonlinear ones in some cases. After the execution of the gradient-based NLP solver, the result of each NLP sub-problem is returned to the outer-layer for further iterations. The heuristic method is responsible to find the global optimum of logic variables. Good performance has been demonstrated by applying the combined method into process synthesis such as heat exchanger networks (HEN) and the integrated water systems.

APPLICATION OF ITERATIVE DYNAMIC PROGRAMMING TO DYNAMIC OPTIMIZATION PROBLEMS

Dynamic Optimization for Chemical Process Based on Improved Iterative Dynamic Programming Algorithm

An approach to iterative dynamic programming for batch reactor systems

Production Optimization for Concentration and Volume-Limited Fed-Batch Reactors in Biochemical Processes

An Improved Quasi-Sequential Approach To Large-Scale Dynamic Process Optimization

Chemical Process Optimization Approach Based on Primal-Dual Interior-Point Method

Optimization in Process Industries and Its Application

A quasi-sequential approach to large-scale dynamic optimization problems

An Effective Simultaneous Approach with Variable Time Nodes for Dynamic Optimization Problems

NEURAL NETWORK BASED ON-LINE RE-OPTIMISATION OF FED-BATCH PROCESSES USING ITERATIVE DYNAMIC PROGRAMMING FOR DISCRETE-TIME SYSTEMS

Object-Oriented Disjunctive Programming with a Nested Heuristic and Gradient-Based Solver for Chemical Process Synthesis

A Bilevel NLP Sensitivity‐based Decomposition for Dynamic Optimization with Moving Finite Elements

Optimization Model for Production Planning Based on Dynamic Programming

Dynamic programming in tasks of optimization of material properties

Dynamic Optimization of Multivariable Endothermic Reaction in Cascade CSTR

Applying Analytical Derivative and Sparse Matrix Techniques to Large-Scale Process Optimization Problems

A Three-section Algorithm of Dynamic Programming Based on Three-stage Decomposition System Model for Grade Transition Trajectory Optimization Problems

Distributed Dynamic Optimization for Chemical Process Networks Based on Differential Games

Optimizing Operations Management and Business Analytics Strategies under Uncertainty: Dynamic Programming

Internal-growth Strategies for Dynamic Process Optimization with Differential-algebraic Equations

Nested Heuristic and Gradient-Based Method for Generalized Disjunctive Programming