Abstract:In 1680 Newton proposed an algorithm for finding roots of polynomials. His method has since evolved but the core concept remains intact. The convergence of Newton's Method has been widely challenged to be unstable or even chaotic. Here we briefly review this evolution, and consider the question of stable convergence. Newton's method may be applied to any complex analytic function, such as polynomials. Its derivation is based on a Taylor series expansion in the Laplace frequency $s=\sigma+\jmath\omega$. The convergence of Newton's method depends on the Region of Convergence (RoC). Under certain conditions, nonlinear (NL) limit-cycles appear, resulting in a reduced rate of convergence to a root. Since Newton's method is inherently complex analytic (that is, linear and convergent), it is important to establish the source of this NL divergence, which we show is due to violations of the Nyquist Sampling theorem, also known as aliasing. Here the conditions and method for uniform convergence are explored. The source of the nonlinear limit-cycle is explained in terms of aliasing. We numerically demonstrate that reducing the step-size always results in a more stable convergence. The down side is that it always results in a sub-optimal convergence. It follows that a dynamic step-size would be ideal, by slowly increasing the step-size until it fails, and then decreasing it in small steps until it converges. Finding the optimal step-size is a reasonable solution.

Newton Algorithms Via Control Liapunov Functions for Polynomial Zero Finding

A Control-Theoretic Approach to the Design of Zero Finding Numerical Methods

Newton's method on two step nilpotent lie groups: convergence criteria and the extended smale point estimate theory

A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Kantorovich’s Theorem for Newton’s Method on Lie Groups

Local Stabilizing Control for Polynomial Nonlinear Systems

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Kantorovich'S Theorems for Newton'S Method for Mappings and Optimization Problems on Lie Groups

Control Synthesis for Polynomial Nonlinear Systems and Application in Attitude Control

Global Linear and Quadratic One-step Smoothing Newton Method for P 0 -LCP

New simultaneous methods for finding all zeros of a polynomial

A Control Liapunov Function Approach to Generalized and Regularized Descent Methods for Zero Finding.

Newton Sketch: A Linear-time Optimization Algorithm with Linear-Quadratic Convergence

Chaotic Convergence of Newton’s method

On the Approximate Zero of Newton Method.

Relaxed Policy Iteration Algorithm for Nonlinear Zero-Sum Games with Application to H-infinity Control

Two-step Newton's method for deflation-one singular zeros of analytic systems

A HYBRID SMOOTHING-NONSMOOTH NEWTON-TYPE ALGORITHM YIELDING AN EXACT SOLUTION OF THE

Superlinear/quadratic one-step smoothing Newton method for P 0 -NCP without strict complementarity

Backtracking New Q-Newton's method, Schröder's theorem, and Linear Conjugacy

A variant smoothing Newton method for P0-NCP based on a new smoothing function