Abstract:We present a new algorithm for automatically bounding the Taylor remainder series. In the special case of a scalar function $f: \mathbb{R} \to \mathbb{R}$, our algorithm takes as input a reference point $x_0$, trust region $[a, b]$, and integer $k \ge 1$, and returns an interval $I$ such that $f(x) - \sum_{i=0}^{k-1} \frac {1} {i!} f^{(i)}(x_0) (x - x_0)^i \in I (x - x_0)^k$ for all $x \in [a, b]$. As in automatic differentiation, the function $f$ is provided to the algorithm in symbolic form, and must be composed of known atomic functions. At a high level, our algorithm has two steps. First, for a variety of commonly-used elementary functions (e.g., $\exp$, $\log$), we use recently-developed theory to derive sharp polynomial upper and lower bounds on the Taylor remainder series. We then recursively combine the bounds for the elementary functions using an interval arithmetic variant of Taylor-mode automatic differentiation. Our algorithm can make efficient use of machine learning hardware accelerators, and we provide an open source implementation in JAX. We then turn our attention to applications. Most notably, in a companion paper we use our new machinery to create the first universal majorization-minimization optimization algorithms: algorithms that iteratively minimize an arbitrary loss using a majorizer that is derived automatically, rather than by hand. We also show that our automatically-derived bounds can be used for verified global optimization and numerical integration, and to prove sharper versions of Jensen's inequality.

An integral expansion for analytic functions based upon the remainder values of the Taylor series expansions

Application of a New Integral Expansion for Solving a Class of Functional Equations

A Functional Expansion for Analytic Functions and Its Subclasses

Taylor's Expansion Revisited: A General Formula for the Remainder

An Extension of the Taylor Series Expansion by Using the Bell Polynomials

Some Expansions of Functions Based Upon Two Sequences of Hypergeometric Polynomials

Series representations of the remainders in the expansion for certain trigonometric and hyperbolic functions with applications

The Faber polynomial expansion method and its application to the general coefficient problem for some subclasses of bi-univalent functions associated with a certain q-integral operator

New Criteria for Starlikness and Convexity of a Certain Family of Integral Operators

A new second order Taylor-like theorem with an optimized reduced remainder

Applications of a Certain Q-Integral Operator to the Subclasses of Analytic and Bi-Univalent Functions

Integral Representations And Integral Transforms Of Some Families Of Mathieu Type Series

Automatically Bounding the Taylor Remainder Series: Tighter Bounds and New Applications

Some families of Mathieu a-series and alternating Mathieu a-series

Exponential Taylor Series

Remarks on Some Series Expansions Associated with Certain Products of the Incomplete Gamma Functions

Series expansion in fractional calculus and fractional differential equations

Functional Power Series

Inclusion Results for Certain Classes of Analytic Functions Associated with a New Fractional Differintegral Operator

Taylor series for the Askey-Wilson operator and classical summation formulas

Taylor expansion for an operator function