Abstract:In this paper, we study asymptotic behaviors of continuous-time and discrete-time gradient flows of a ``lower-unbounded" convex function $f$ on a Hadamard manifold $M$, particularly, their convergence properties to the boundary $M^{\infty}$ at infinity of $M$. We establish a duality theorem that the infimum of the gradient-norm $\|\nabla f(x)\|$ of $f$ over $M$ is equal to the supremum of the negative of the recession function $f^{\infty}$ of $f$ over the boundary $M^{\infty}$, provided the infimum is positive. Further, the infimum and the supremum are obtained by the limits of the gradient flows of $f$, Our results feature convex-optimization ingredients of the moment-weight inequality for reductive group actions by Georgoulas, Robbin, and Salamon,and are applied to noncommutative optimization by Bürgisser et al. FOCS 2019. We show that the gradient descent of the Kempf-Ness function for an unstable orbit converges to a 1-parameter subgroup in the Hilbert-Mumford criterion, and the associated moment-map sequence converges to the mimimum-norm point of the moment polytope. We show further refinements for operator scaling -- the left-right action on a matrix tuple $A= (A_1,A_2,\ldots,A_N)$. We characterize the gradient-flow limit of operator scaling via a vector-space generalization of the classical Dulmage-Mendelsohn decomposition of a bipartite graph. Also, for a special case of $N = 2$, we reveal that this limit determines the Kronecker canonical form of matrix pencils $s A_1+A_2$.

Hypodifferentials of nonsmooth convex functions and their applications to nonsmooth convex optimization

Abstract convex approximations of nonsmooth functions

Generalized Hukuhara Weak Subdifferential and its Application on Identifying Optimality Conditions for Nonsmooth Interval-valued Functions

Accelerated optimization algorithms and ordinary differential equations: the convex non Euclidean case

Analyzing the speed of convergence in nonsmooth optimization via the Goldstein subdifferential with application to descent methods

Introduction to Nonsmooth Analysis and Optimization

First-order Optimality Conditions for Two Classes of Generalized Nonsmooth Semi-Infinite Optimization

Convex and Non-convex Optimization Under Generalized Smoothness

Subdifferentials of convex matrix-valued functions

Codifferentials and Quasidifferentials of the Expectation of Nonsmooth Random Integrands and Two-Stage Stochastic Programming

A convergence analysis of the method of codifferential descent

A dynamic gradient approach to Pareto optimization with nonsmooth convex objective functions

On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights

A study of convex convex-composite functions via infimal convolution with applications

Gradient descent for unbounded convex functions on Hadamard manifolds and its applications to scaling problems

Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems

A Descent Method for Nonsmooth Multiobjective Optimization in Hilbert Spaces

Generalized Derivatives and Optimality Conditions in Nonconvex Optimization

Non-subdifferentiability optimality and mean value theorems via new relative subdifferentials

Second-order subdifferential calculus with applications to tilt stability in optimization

A differential Harnack inequality for noncompact evolving hypersurfaces