Abstract:Dynamic programming (DP) is an algorithmic design paradigm for the efficient, exact solution of otherwise intractable, combinatorial problems. However, DP algorithm design is often presented in an ad-hoc manner. It is sometimes difficult to justify algorithm correctness. To address this issue, this paper presents a rigorous algebraic formalism for systematically deriving DP algorithms, based on semiring polymorphism. We start with a specification, construct an algorithm to compute the required solution which is self-evidently correct because it exhaustively generates and evaluates all possible solutions meeting the specification. We then derive, through the use of shortcut fusion, an implementation of this algorithm which is both efficient and correct. We also demonstrate how, with the use of semiring lifting, the specification can be augmented with combinatorial constraints, showing how these constraints can be fused with the algorithm. We furthermore demonstrate how existing DP algorithms for a given combinatorial problem can be abstracted from their original context and re-purposed. This approach can be applied to the full scope of combinatorial problems expressible in terms of semirings. This includes, for example: optimal probability and Viterbi decoding, probabilistic marginalization, logical inference, fuzzy sets, differentiable softmax, relational and provenance queries. The approach, building on ideas from the existing literature on constructive algorithmics, exploits generic properties of polymorphic functions, tupling and formal sums and algebraic simplifications arising from constraint algebras. We demonstrate the effectiveness of this formalism for some example applications arising in signal processing, bioinformatics and reliability engineering. Python software implementing these algorithms can be downloaded from: <a class="link-external link-http" href="http://www.maxlittle.net/software/dppolyalg.zip" rel="external noopener nofollow">this http URL</a>.

Efficient Dynamic Programming Using Quadrangle Inequalities

A Comparison of Arithmetic Operations for Dynamic Process Optimization Approach

Speed-Up in Dynamic-Programming

Parallel and (Nearly) Work-Efficient Dynamic Programming

Solving Convex Quadratic Programming by Potential-Reduction Interior-Point Algorithm

Dynamic Programming Deconstructed: Transformations of the Bellman Equation and Computational Efficiency

A Simple Effective Heuristic for Embedded Mixed-Integer Quadratic Programming

An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

Improving locality of nonserial polyadic dynamic programming

Quadratic unconstrained binary optimization problem preprocessing: Theory and empirical analysis

A fast algorithm for quadratic resource allocation problems with nested constraints

Efficient Algorithm for Solving Hyperbolic Programs

A Parametric Approach for Solving Convex Quadratic Optimization with Indicators Over Trees

Dynamic Maintenance of Monotone Dynamic Programs and Applications

An Approximate Dynamic Programming Approach to Convex Quadratic Knapsack Problems

A New Algorithm for Finding Global Solution of Indefinite Quadratic Programming Problems

A Variable Depth Sequential Search Heuristic for the Quadratic Assignment Problem

Dynamic programming by polymorphic semiring algebraic shortcut fusion

Faster Algorithms for Structured Linear and Kernel Support Vector Machines

Fast Local Search Strategies for Large-Scale General Quadratic Integer Programming

Automatically Tuned Dynamic Programming with an Algorithm-by-Blocks