Abstract:In this paper, we propose a polynomial kernel neural network classifier (PKNNC) based on the random sampling and information gain. Random sampling is used here to generate datasets for the construction of polynomial neurons located in the neural networks, while information gain is used to evaluate the importance of the input variables (viz. dataset features) of each neuron. Both random sampling and information gain stem from the concepts of well-known random forest models. Some traditional neural networks have certain limitations, such as slow convergence speed, easily falling to local optima and difficulty describing the polynomial relation between the input and output. In this regard, a general PKNNC is proposed, and it consists of three parts: the premise, conclusion, and aggregation. The method of designing the PKNNC is summarized as follows. In the premise section, random sampling and information gain are used to obtain multiple subdatasets that are passed to the aggregation part, and the conclusion part uses three types of polynomials. In the aggregation part, the least squares method (LSM) is used to estimate the parameters of polynomials. Furthermore, the particle swarm optimization (PSO) algorithm is exploited here to optimize the PKNNC. The overall optimization of the PKNNC combines structure optimization and parameter optimization. The PKNNC takes advantage of three types of polynomial kernel functions, random sampling techniques and information gain algorithms, which have a good ability to describe the higher-order nonlinear relationships between input and output variables and have high generalization and fast convergence capabilities. To evaluate the effectiveness of the PKNNC, numerical experiments are carried out on two types of data: machine learning data and face data. A comparative study illustrates that the proposed PKNNC leads to better performance than several conventional models.

PCA-based Probability Neural Network Structure Optimization

Principal Component Analysis Based Probability Neural Network Optimization

Efficient Structure Slimming for Spiking Neural Networks

Dynamic Optimization of Neural Network Structures Using Probabilistic Modeling

Bucketed PCA Neural Networks with Neurons Mirroring Signals

Indeterminate Probability Neural Network

A New Method of PCNN's Parameter's Optimization

Rethinking the Usage of Batch Normalization and Dropout in the Training of Deep Neural Networks

Controlling Model Complexity in Probabilistic Model-Based Dynamic Optimization of Neural Network Structures

A PCA-Based Convolutional Network

A New Method for Decision on the Structure of RBF Neural Network

Dense Optimizer : An Information Entropy-Guided Structural Search Method for Dense-like Neural Network Design

Understanding and Improving Optimization in Predictive Coding Networks

Probabilistic Neural Circuits

A polynomial kernel neural network classifier based on random sampling and information gain

Research on Quality Anomaly Recognition Method Based on Optimized Probabilistic Neural Network

Biologically Plausible Online Principal Component Analysis Without Recurrent Neural Dynamics

Exploring Complex Multivariate Probability Distributions with Simple and Robust Bayesian Network Topology for Classification

Model Based and Physics Informed Deep Learning Neural Network Structures

An Improved Probabilistic Spiking Neural Network with Enhanced Discriminative Ability

nPCA: a linear dimensionality reduction method using a multilayer perceptron