Abstract:While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as diagonally-weighted $\ell_{1}$ or $\ell_{\infty}$ norms. This paper provides a natural generalization of monotone operator theory to finite-dimensional non-Euclidean spaces. The key tools are weak pairings and logarithmic norms. We show that the resolvent and reflected resolvent operators of non-Euclidean monotone mappings exhibit similar properties to their counterparts in Hilbert spaces. Furthermore, classical iterative methods and splitting methods for finding zeros of monotone operators are shown to converge in the non-Euclidean case. We apply our theory to equilibrium computation and Lipschitz constant estimation of recurrent neural networks, obtaining novel iterations and tighter upper bounds via forward-backward splitting.

Monotone Normality and Neighborhood Assignments

Skew Calabi-Yau Property of Normal Extensions

ASYMPTOTIC NORMALITY OF KERNEL ESTIMATES OF A DENSITY FUNCTION UNDER ASSOCIATION DEPENDENCE

Semi-proximal spaces and normality

A Glance into the Anatomy of Monotonic Maps

Essential Normality - a Unified Approach in Terms of Local Decompositions

The Dual Normal Chip and Linear Regularity for Infinite Systems of Convex Sets in Banach Spaces

A Note on Monotone $D$-Spaces

A Banach space whose set of norm-attaining functionals is algebraically trivial

A harmonic analysis approach to essential normality of principal submodules

Essential normality of quotient submodules over strongly pseudoconvex finite manifolds

On the $P$-Essential Normality of Principal Submodules of the Bergman Module on Strongly Pseudoconvex Domains

P -Essential Normality of Quasi-Homogeneous Drury-Arveson Submodules

Discrete subgroups of normed spaces are free

A Characterization of Monotonically Lindelöf Generalized Ordered Spaces

On Invariant subspace for hyponormal operators

Weak normality and seminormality in the mixed characteristic case

An asymptotic analog of a local-to-global phenomenon for uniformly convex renormings

Non-Euclidean Monotone Operator Theory and Applications

Normal structure spaces of groups

Strictly convex norms and the local diameter two property