Abstract:The optimization of real scalar functions of quaternion variables, such as the mean square error or array output power, underpins many practical applications. Solutions typically require the calculation of the gradient and Hessian. However, real functions of quaternion variables are essentially nonanalytic, which are prohibitive to the development of quaternion-valued learning systems. To address this issue, we propose new definitions of quaternion gradient and Hessian, based on the novel generalized Hamilton-real (GHR) calculus, thus making a possible efficient derivation of general optimization algorithms directly in the quaternion field, rather than using the isomorphism with the real domain, as is current practice. In addition, unlike the existing quaternion gradients, the GHR calculus allows for the product and chain rule, and for a one-to-one correspondence of the novel quaternion gradient and Hessian with their real counterparts. Properties of the quaternion gradient and Hessian relevant to numerical applications are also introduced, opening a new avenue of research in quaternion optimization and greatly simplified the derivations of learning algorithms. The proposed GHR calculus is shown to yield the same generic algorithm forms as the corresponding real- and complex-valued algorithms. Advantages of the proposed framework are illuminated over illustrative simulations in quaternion signal processing and neural networks.

Constrained Quaternion-Variable Convex Optimization: A Quaternion-Valued Recurrent Neural Network Approach

A Quaternion-Valued Neural Network Approach to Nonsmooth Nonconvex Constrained Optimization in Quaternion Domain

One-Layer Neural Network for Nonlinear Convex Programming with Linear Constraints

Penalty Method for Constrained Distributed Quaternion-Variable Optimization

Learning Algorithms in Quaternion Neural Networks Using Ghr Calculus

Optimization in Quaternion Dynamic Systems: Gradient, Hessian, and Learning Algorithms.

A Neurodynamic Approach to Nonsmooth Quaternion Distributed Convex Optimization With Inequality and Affine Equality Constraints

A general framework for constrained convex quaternion optimization

A discrete-time neural network for optimization problems with hybrid constraints.

Stability Analysis of Quaternion-Valued Neural Networks: Decomposition and Direct Approaches.

Global stability and synchronization of stochastic discrete-time variable-order fractional-order delayed quaternion-valued neural networks

Finite-time Stabilization of Quaternion-Valued Neural Networks with Time Delays: an Implicit Function Method.

Globally Finite-Time Stabilization of Delayed Quaternion-Valued Neural Networks Based on a Class of Extended L-R Method.

A One-Layer Recurrent Neural Network for Constrained Complex-Variable Convex Optimization.

A Fractional-Order Gradient Neural Solution to Time-Variant Quadratic Programming With Application to Robot Motion Planning

A Neurodynamic Approach to Convex Optimization Problems with General Constraint.

Widely Linear Quaternion Unscented Kalman Filter for Quaternion-Valued Feedforward Neural Network.

Global Μ-Stability Criteria for Quaternion-Valued Neural Networks with Unbounded Time-Varying Delays

Global exponential stability for quaternion-valued recurrent neural networks with time-varying delays

Decomposition Approach to the Stability of Recurrent Neural Networks with Asynchronous Time Delays in Quaternion Field

Local Lagrange Exponential Stability Analysis of Quaternion-Valued Neural Networks with Time Delays