Convergence of trust-region algorithms in compact metric spaces

Paul Manns
2024-12-17
Abstract:Trust-region algorithms can be applied to very abstract optimization problems because they do not require a specific direction of descent or anti-gradient. This has lead to recent interest in them, in particular in the area of integer optimal control problems, where the infinite-dimensional problem formulations do not assume vector space structure. We analyze a trust-region algorithm in the abstract setting of a compact metric space, a setting in which integer optimal control problems with total variation regularization can be formulated in. Our analysis allows to avoid a reset of the trust-region radius upon acceptance of the iterates when proving convergence to stationary points. This reset has been present in previous analyses of trust-region algorithms for integer optimal control problems. Our computational benchmark shows that the runtime can be considerably improved when avoiding this reset, which is now theoretically justified.
Optimization and Control
What problem does this paper attempt to address?