A note on the complex and bicomplex valued neural networks

Daniel Alpay,Kamal Diki,Mihaela Vajiac
DOI: https://doi.org/10.48550/arXiv.2202.02354
2022-02-05
Abstract:In this paper we first write a proof of the perceptron convergence algorithm for the complex multivalued neural networks (CMVNNs). Our primary goal is to formulate and prove the perceptron convergence algorithm for the bicomplex multivalued neural networks (BMVNNs) and other important results in the theory of neural networks based on a bicomplex algebra.
Machine Learning,Information Theory,Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to generalize the classical perceptron convergence algorithm to complex and bicomplex neural networks and prove its convergence in these extended cases. Specifically, the main objectives of the authors include: 1. **Perceptron Convergence Algorithm for Complex Multi - valued Neural Networks (CMVNNs)**: First, provide a proof of the perceptron convergence algorithm for complex multi - valued neural networks. 2. **Perceptron Convergence Algorithm for Bicomplex Multi - valued Neural Networks (BMVNNs)**: The main objective is to construct and prove the perceptron convergence algorithm in bicomplex multi - valued neural networks and its related theoretical results. ### Main Problem Background - **Introduction to Perceptron**: A perceptron is a linear classifier with a nonlinear activation function and is an important example of a supervised learning algorithm. It was originally proposed by psychologist Frank Rosenblatt in 1958, based on the neuron model of McCulloch and Pitts, and aimed to define Hebb's learning model. - **Existing Work**: There has been a great deal of research on the proof and application of the perceptron convergence theorem, especially in the real number field. However, with the rise of fields such as quantum computing, research on complex and bicomplex perceptrons has become increasingly important. ### Research Motivation - **Requirements of Quantum Computing**: Due to the requirements of quantum computing, there has been a revival of interest in perceptrons. This paper hopes to open up new research directions in this field through research on bicomplex perceptrons. - **Importance of Bicomplex Algebraic Structure**: The special structure of bicomplex algebra enables it to better combine two complex - valued networks, rather than just a simple two - valued method. Therefore, research on bicomplex perceptrons helps to simplify calculations, reduce errors, and improve convergence. ### Specific Problem Description - **Generalization of Complex Perceptron**: First, extend the perceptron convergence algorithm to the complex number field and give a new proof. - **Convergence of Bicomplex Perceptron**: Then establish the foundation of the bicomplex perceptron and prove its convergence. This is one of the core contributions of this paper. Through these works, the authors hope to provide a solid theoretical foundation for the development of complex and bicomplex neural networks and pave the way for further research.