Abstract:Recently, applications of complex-valued neural networks (CVNNs) to real-valued classification problems have attracted significant attention. However, most existing CVNNs are black-box models with poor explanation performance. This study extends the real-valued group method of data handling (RGMDH)-type neural network to the complex field and constructs a circular complex-valued group method of data handling (C-CGMDH)-type neural network, which is a white-box model. First, a complex least squares method is proposed for parameter estimation. Second, a new complex-valued symmetric regularity criterion is constructed with a logarithmic function to represent explicitly the magnitude and phase of the actual and predicted complex output to evaluate and select the middle candidate models. Furthermore, the property of this new complex-valued external criterion is proven to be similar to that of the real external criterion. Before training this model, a circular transformation is used to transform the real-valued input features to the complex field. Twenty-five real-valued classification data sets from the UCI Machine Learning Repository are used to conduct the experiments. The results show that both RGMDH and C-CGMDH models can select the most important features from the complete feature space through a self-organizing modeling process. Compared with RGMDH, the C-CGMDH model converges faster and selects fewer features. Furthermore, its classification performance is statistically significantly better than the benchmark complex-valued and real-valued models. Regarding time complexity, the C-CGMDH model is comparable with other models in dealing with the data sets that have few features. Finally, we demonstrate that the GMDH-type neural network can be interpretable.

Adaptive CL-BFGS Algorithms for Complex-Valued Neural Networks

A L-BFGS Based Learning Algorithm for Complex-Valued Feedforward Neural Networks

A Multilayer Complex Neural Network Training Algorithm and Its Application in Adaptive Equalization

A Complex Hebbian-type Learning Algorithm with Application to Complex Adaptive ⅡR Filtering

Adaptive Genetic Algorithms for FFN-Based Dynamic Identification

Optimal approximation using complex-valued neural networks

Circular Complex-Valued GMDH-Type Neural Network for Real-Valued Classification Problems

Associative memory with a controlled chaotic neural network.

An Input Weights Dependent Complex-Valued Learning Algorithm Based on Wirtinger Calculus

General Cauchy Conjugate Gradient Algorithms Based on Multiple Random Fourier Features

Complex-valued soft-log threshold reweighting for sparsity of complex-valued convolutional neural networks

Complex-valued Neural Networks -- Theory and Analysis

Conjugate Gradient-Based FLANN Algorithms in Nonlinear Active Noise Control

FB-CCNN: A Filter Bank Complex Spectrum Convolutional Neural Network with Artificial Gradient Descent Optimization

AdaCL:Adaptive Continual Learning

Multistability of almost periodic solution for Clifford-valued Cohen–Grossberg neural networks with mixed time delays

Learning the Step-size Policy for the Limited-Memory Broyden-Fletcher-Goldfarb-Shanno Algorithm

Comprehensive Survey of Complex-Valued Neural Networks: Insights into Backpropagation and Activation Functions

Optimal Gradient Checkpoint Search for Arbitrary Computation Graphs

Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling

Interactive Continual Learning: Fast and Slow Thinking