Theory and applications of generalized dynamic programming: An overview

R.L. Carraway,T.L. Morin
DOI: https://doi.org/10.1016/0898-1221(88)90188-5
1988-01-01
Abstract:Extensions of dynamic programming (DP) into generalized preference structures, such as exist in multicriteria optimization, have invariably assumed sufficient structure to ensure the validity of Bellman's “principle of optimality” or the presence of monotonicity, hence ensuring the validity of the functional equations of DP. Often, however, the only reasonable formulation of problem (in terms of the size of the resulting state space) is one for which neither monotonicity nor the (strong) principle of optimality is satisfied. Generalized DP, based on a weaker principle of optimality, is a generalization of DP that produces optimal solutions, even in the absence of monotonicity. It is shown both to subsume conventional DP and to provide an alternative means of implementing Mitten's preference order DP. This paper provides an overview of generalized DP and its applications to date, summarizing our computational experiences in the process.
mathematics, applied
What problem does this paper attempt to address?