Abstract:Complex-valued neural network is a kind of learning model which can deal with problems in complex domain. Fully complex extreme learning machine (CELM) is a much faster training algorithm than the complex backpropagation (CBP) scheme. However, it is at the cost of using more hidden nodes to obtain the comparable performance. An upper-layer-solution-aware algorithm has been proposed for training single-hidden layer feedforward neural networks, which performs much better than its counterparts, pseudo-inverse learning (PIL)/extreme learning machine and gradient decent-based backpropagation neural networks. Consequently, there exist two challenges that need to be dealt with: 1) How to combine the advantages of CBP and CELM to develop a novel complex learning algorithm? and 2) What is the convergent behavior of the presented algorithm? In this article, an input weights dependent complex-valued (IWDCV) learning algorithm based on Wirtinger calculus has been proposed, which effectively solves the nonanalytic problem of the common activation functions during training neural networks. In addition, the monotonicity of the error function and the deterministic convergence of the proposed model have been strictly proved, which theoretically guarantee the efficiency and effectiveness of the given model, IWDCV. Finally, for real and complex-valued problems, a variety of simulations have been done to demonstrate the comparable performance of the proposed algorithm which support the theoretical observations as well.

A Complex Hebbian-type Learning Algorithm with Application to Complex Adaptive ⅡR Filtering

A Multilayer Complex Neural Network Training Algorithm and Its Application in Adaptive Equalization

Complex-Valued Recurrent Neural Network with IIR Neuron Model: Training and Applications

An Input Weights Dependent Complex-Valued Learning Algorithm Based on Wirtinger Calculus

Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy.

Learning-induced Pattern Classification in a Chaotic Neural Network

Complex-Valued Wavelet Network

A class of adaptive filtering algorithms based on improper complex correntropy

Complex-Valued Feedforward Neural Networks Learning Without Backpropagation

Adaptive Complex-Valued Stepsize Based Fast Learning of Complex-Valued Neural Networks.

A L-BFGS Based Learning Algorithm for Complex-Valued Feedforward Neural Networks

Online Sequential Complex-Valued ELM for Noncircular Signals: Augmented Structures and Learning Algorithms

Adaptive filtering in the complex domain

Deep Filtering With Adaptive Learning Rates

A Hybrid Complex Spectral Conjugate Gradient Learning Algorithm for Complex-Valued Data Processing

Adaptive Iterative Learning Control for Complex Dynamical Networks

Communication Channel Equalization [J]

Kernel Adaptive Filtering Over Complex Networks

An Efficient Algorithm for Complex-Valued Neural Networks Through Training Input Weights

A Levenberg-Marquardt Algorithm Based Incremental Scheme for Complex-Valued Neural Networks

Convergence of a Hebbian-type learning algorithm