Abstract:The single-hidden-layer feedforward neural network (SLFN) exhibits an excellent approximation ability, despite its simple structure. This study examines two neural network models developed based on the general structure of the SLFN, i.e., the weights-and-structure-determination (WASD) neural network and broad learning system (BLS). The BLS and WASD neural networks exhibit many similarities in terms of their structure and algorithm, while BLS incorporates certain distinct ideas that render it an improved version of the WASD neural network. The research described in this paper is the first approach to establish a connection between the BLS and WASD neural networks. Moreover, pattern classification experiments on a foot dataset and several benchmark datasets are conducted using these two kinds of neural network models, and the performance of different models is compared and analyzed. Experimental results show that dividing the feature nodes into one group is the best choice for our foot dataset, and that the cross-layer connectivity and sparse coding of BLS can effectively improve the classification accuracy. In addition, it is shown that the dynamic update algorithm of BLS can improve the accuracy and save a lot of time when updating the model structure, but the final accuracy depends on the initial structure and parameters. Comparative experiments show that BLS achieves 89.12% classification accuracy for the foot dataset, which is the highest among all the demonstrated WASD neural networks and two other SLFN models. Finally, extended experiments on five benchmark datasets show that BLS can achieve satisfactory accuracy on multiple types of datasets, while WASD neural networks are possibly inadequate in processing image datasets in contrast.

WASD neural network activated by bipolar sigmoid functions together with subsequent iterations

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

Sine Neural Network (SNN) with Double-Stage Weights and Structure Determination (DS-WASD)

A neuron-weighted learning algorithm and its hardware implementation in associative memories

Unipolar Sigmoid Neural Network Classifier Based on Weights and Structure Determination Method

The 3-Input Euler Polynomial Neuronet (3IEPN) with Weights-and-structure-determination (WASD) Algorithm

Two-Input Power-Activation Neural Network Weights-Direct-Determination and Structure Optimized by Particle Swarm Optimization

Weights and Structure Determination of Two-Input Power-Activation Feed-Forward Neural Network

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Apply signum-activated WASD neuronet to learning XOR logic via noisy input and output data

Signum-Function-Activated WASD Neuronet and Its XOR Application

Weight and Structure Determination Neural Network Aided with Double Pseudoinversion for Diagnosis of Flat Foot.

Wasd Algorithm With Pruning-While-Growing And Twice-Pruning Techniques For Multi-Input Euler Polynomial Neural Network

Weights and Structure Determination of Pruning-While-Growing Type for 3-Input Power-Activation Feed-Forward Neuronet

Growing-type Weights and Structure Determination of 2-Input Legendre Orthogonal Polynomial Neuronet.

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Weights and Structure Determination of Multiple-Input Feed-Forward Neural Network Activated by Chebyshev Polynomials of Class 2 Via Cross-Validation

RBF Neural Network Classifier with Weights and Structure Determination Method

From WASD to BLS with application to pattern classification