Abstract:A formulation for the automated generation of algorithms via mathematical programming (optimization) is proposed. The formulation is based on the concept of optimizing within a parameterized family of algorithms, or equivalently a family of functions describing the algorithmic steps. The optimization variables are the parameters -within this family of algorithms- that encode algorithm design: the computational steps of which the selected algorithms consists. The objective function of the optimization problem encodes the merit function of the algorithm, e.g., the computational cost (possibly also including a cost component for memory requirements) of the algorithm execution. The constraints of the optimization problem ensure convergence of the algorithm, i.e., solution of the problem at hand. The formulation is described prototypically for algorithms used in solving nonlinear equations and in performing unconstrained optimization; the parametrized algorithm family considered is that of monomials in function and derivative evaluation (including negative powers). A prototype implementation in GAMS is developed along with illustrative results demonstrating cases for which well-known algorithms are shown to be optimal. The formulation is a mixed-integer nonlinear program (MINLP). To overcome the multimodality arising from nonconvexity in the optimization problem, a combination of brute force and general-purpose deterministic global algorithms is employed to guarantee the optimality of the algorithm devised. We then discuss several directions towards which this methodology can be extended, their scope and limitations.

An algorithm for the optimal solution of variable knockout problems

IdealKnock: A framework for efficiently identifying knockout strategies leading to targeted overproduction

An Active-set Algorithm for Discrete Network Design Problems

On Controlling Knockout Tournaments Without Perfect Information

Quadratic unconstrained binary optimization problem preprocessing: Theory and empirical analysis

A Class of Polynomially Solvable 0–1 Programming Problems and an Application

Optimal Design of Binary Weighted K-Out-Of-N Systems

The Zero Regrets Algorithm: Optimizing over Pure Nash Equilibria via Integer Programming

An Exact Algorithm for 0-1 Polynomial Knapsack Problems

Variable Programming: A Generalized Minimax Problem. Part Ii: Algorithms

Optimal Deterministic Algorithm Generation

An Exact Algorithm for Bilevel 0-1 Knapsack Problems

An Exact Algorithm for Optimization Problems with Inverse S-shaped Function

Optimal Online Algorithms for One-Way Trading and Online Knapsack Problems: A Unified Competitive Analysis

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism

Robust Draws in Balanced Knockout Tournaments

Variable reduction as a nonlinear preconditioning approach for optimization problems

Optimal Constructions of Hybrid Algorithms

The Design of Ε-Optimal Strategy for Two-Person Zero-Sum Markov Games

Almost optimal manipulation of a pair of alternatives

Complexity and Algorithms of K-implementation.