Abstract:Complex-valued neural networks (CVNNs) bring in nonholomorphic functions in two ways: (i) through their loss functions and (ii) the widely used activation functions. The derivatives of such functions are defined in Wirtinger calculus. In this paper, we derive two popular algorithms—the gradient descent and the Levenberg-Marquardt (LM) algorithm—for parameter optimization in the feedforward CVNNs using the Wirtinger calculus, which is simpler than the conventional derivation that considers the problem in real domain. While deriving the LM algorithm, we solve and use the result of a least squares problem in the complex domain,$\|\mathbf{b-(Az+Bz^*)}\|_{\underset{\mathbf{z}}{\min}}$, which is more general than the $\|\mathbf{b-Az}\|_{\underset{\mathbf{z}}{\min}}$. Computer simulation results exhibit that as with the real-valued case, the complex-LM algorithm provides much faster learning with higher accuracy than the complex gradient descent algorithm. $|\mathbf{b-(Az+Bz^*)}\|_{\underset{\mathbf{z}}{\min}}$, which is more general than the $\|\mathbf{b-Az}\|_{\underset{\mathbf{z}}{\min}}$. Computer simulation results exhibit that as with the real-valued case, the complex-LM algorithm provides much faster learning with higher accuracy than the complex gradient descent algorithm. $|\mathbf{b-(Az+Bz^*)}\|_{\underset{\mathbf{z}}{\min}}$, which is more general than the $\|\mathbf{b-Az}\|_{\underset{\mathbf{z}}{\min}}$. Computer simulation results exhibit that as with the real-valued case, the complex-LM algorithm provides much faster learning with higher accuracy than the complex gradient descent algorithm. $|\mathbf{b-(Az+Bz^*)}\|_{\underset{\mathbf{z}}{\min}}$, which is more general than the $\|\mathbf{b-Az}\|_{\underset{\mathbf{z}}{\min}}$. Computer simulation results exhibit that as with the real-valued case, the complex-LM algorithm provides much faster learning with higher accuracy than the complex gradient descent algorithm.

Error Selection Based Training of Fully Complex-Valued Dendritic Neuron Model

Stochastic Adaptive CL-BFGS Algorithms for Fully Complex-Valued Dendritic Neuron Model

Cuckoo Search Algorithm with Membrane Communication Mechanism for Modeling Overhead Crane Systems Using RBF Neural Networks.

Fully Complex-Valued Dendritic Neuron Model.

An Input Weights Dependent Complex-Valued Learning Algorithm Based on Wirtinger Calculus

A Levenberg-Marquardt Algorithm Based Incremental Scheme for Complex-Valued Neural Networks

A L-BFGS Based Learning Algorithm for Complex-Valued Feedforward Neural Networks

Adaptive Complex-Valued Stepsize Based Fast Learning of Complex-Valued Neural Networks.

A Complex Hebbian-type Learning Algorithm with Application to Complex Adaptive ⅡR Filtering

Adaptive CL-BFGS Algorithms for Complex-Valued Neural Networks

A Multilayer Complex Neural Network Training Algorithm and Its Application in Adaptive Equalization

A Training Algorithm with Selectable Search Direction for Complex-Valued Feedforward Neural Networks.

An Efficient Hybrid Incremental Algorithm for Complex-Valued Feedforward Neural Networks

An Efficient Algorithm for Complex-Valued Neural Networks Through Training Input Weights

Complex-Valued Recurrent Neural Network with IIR Neuron Model: Training and Applications

Wirtinger calculus based gradient descent and levenberg-marquardt learning algorithms in complex-valued neural networks

A New Learning Algorithm for Fully Complex-Valued Rbf Networks

Second-Order Structure Optimization of Fully Complex-Valued Neural Networks

Modelling of Electrohydraulic System Using RBF Neural Networks and Genetic Algorithm

An Optimization Method for the Initial Parameters Selection of Fuzzy Cerebellar Model Neural Networks in Parametric Fault Diagnosis

Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy.