Algorithms As Dynamical Systems with Feedback
Amit Bhaya,Eugenius Kaszkurewicz
DOI: https://doi.org/10.1137/1.9780898718669.ch2
2006-01-01
Abstract:Previous chapter Next chapter Advances in Design and Control Control Perspectives on Numerical Algorithms and Matrix Problems2. Algorithms as Dynamical Systems with Feedbackpp.41 - 91Chapter DOI:https://doi.org/10.1137/1.9780898718669.ch2PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAboutExcerpt Algorithms are inventions which very often appear to have little or nothing in common with one another. As a result, it was held for a long time that a coherent theory of algorithms could not be constructed. The last few years have shown that this belief was incorrect, that most convergent algorithms share certain basic properties, and hence a unified approach to algorithms is possible. —E. L. Polak [Pol71] At the risk of oversimplification, it can be said that the design of a successful numerical algorithm usually involves the choice of some parameters in such a way that a suitable measure of some residue or error decreases to a reasonably small value as fast as possible. Although this is the case with most numerical algorithms, they are usually analyzed on a case by case basis: there is no general framework to guide the beginner, or even the expert, in the choice of these parameters. At a more fundamental level, one can even say that the very choice of strategy that results in the introduction of the parameters to be chosen is not usually discussed. Thus, the intention of this chapter, and of this book, is to revisit the question raised in the above quote, suggesting that control theory provides a framework for the design or discovery of algorithms in a systematic way. Control theory, once again oversimplifying considerably, is concerned with the problem of regulation. Given a system model, generally referred to as a plant, that describes the behavior of some variables to be controlled, the problem of regulation is that of finding a mechanism that either keeps or regulates these variables at constant values, despite changes or disturbances that may act on the system as a whole. A fundamental idea is that of feedback: The variable to be controlled is compared with the constant value that is desired, and a difference (error, or residue) variable is generated. This error variable is used (fed back) by a parameter-dependent control mechanism to influence the plant in such a way that the controlled variable is driven (or converges) to the desired value. This results in zero error and, consequently, zero control action, as long as no disturbance occurs. The point to be emphasized here is that, in the six decades or so of development of mathematical control theory, several approaches have been developed to the systematic introduction and choice of the so-called feedback control parameters in the regulation problem. Previous chapter Next chapter RelatedDetails Published:2006ISBN:978-0-89871-602-3eISBN:978-0-89871-866-9 https://doi.org/10.1137/1.9780898718669Book Series Name:Advances in Design and ControlBook Code:DC10Book Pages:xxv + 265Key words:Control theory, system theory, iterative methods, numerical methods for ODEs, Liapunov functions, gradient dynamical systems