Optimal control for both forward and backward discrete-time systems
Xin Chen,Yue Yuan,Dongmei Yuan,Xiao Ge
DOI: https://doi.org/10.1016/j.matcom.2024.03.009
IF: 3.601
2024-03-14
Mathematics and Computers in Simulation
Abstract:Forward discrete-time systems use past information to update the current state, while backward discrete-time systems use future information to update the current state. This study focuses on optimal control problems within the context of forward and backward discrete-time systems. We begin by investigating a general optimal control problem for both forward and backward discrete-time systems. Leveraging the inherent properties of these systems and the Bellman optimality principle, we derive recursive equations as a means to solve such optimal control problems. Using these recursive equations, we obtain analytical expressions for both the optimal controls and optimal values of bang–bang and linear quadratic optimal control problems. Finally, we present a numerical example and an industrial wastewater treatment problem to illustrate and demonstrate our findings.
mathematics, applied,computer science, software engineering, interdisciplinary applications