Abstract:In this study, a design methodology based on fuzzy relation-based neural networks for stabilized network structure is introduced to cope with over-fitting as well as multi-collinearity problems which generally appear in conventional fuzzy neural networks. The design method of the proposed self-organizing network structure provides an efficient solution to construct the stabilized Fuzzy Relation-based Neural Networks (FRNN) through a synergy of multi-techniques such as ensemble neurons/layers, L2-norm regularization, compromise technique, and multi-optimization, in order to generate the structure of the multi-layered self-organizing network designed with the aid of the learning as well as novel structural design.The overall network structure is realized with the aid of parallel network structure with newly added layers as well as effective node selection method through the combination technique of both a sum of squared coefficients (SSC) and performance index (PI) as a node selection criterion for each layer in FRNN. Ensemble neurons consist of the current inputs and the original inputs, and they serve to reduce the bias of the proposed FRNN by maintaining the information of the original inputs. Also, ensemble layers stand for the combination of the current layer and the front layer, and they play a role for control the variance of the model by taking into account the output of the previous layers. The least square error estimation (LSE)-based learning method with L2-norm regularization is used for constructing the stabilized network architecture, and their ensuring design methodologies result in alleviating the overfitting phenomenon and also enhancing the generalization ability. For the performance enhancement of FRNN directly affected by some parameters such as the number of input variables, collocation of the specific subset of input variables, the number of membership functions per each variable, and the order of polynomial in the consequent parts of the fuzzy rules, multi-particle swarm optimization (MPSO) is exploited for the effectively structural as well as parametric optimization of the proposed networks. That is, the multi-optimization helps achieve a compromise between the better generation performance and the alleviated over-fitting leading to the stabilization of the proposed multi-layered self-organizing network structure realized with the aid of synergistic multi-techniques and ensemble structures such as a) L2-norm regularization-based LSE learning, b) combination technique for effective node selection through the combination of SSC and PI, and c) a novel parallel network structure including newly added layers and node selection method. The performance of the proposed network structure is quantified by comprehensive experiments and comparative analysis.

Reinforced Fuzzy Rule-based Neural Networks Realized Through Streamlined Feature Selection Strategy and Fuzzy Clustering with Distance Variation

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

Reinforced Two-Stream Fuzzy Neural Networks Architecture Realized with the Aid of One-Dimensional/Two-Dimensional Data Features

Design of Reinforced Fuzzy Radial Basis Function Neural Network Classifier Driven With the Aid of Iterative Learning Techniques and Support Vector-Based Clustering

Design of Reinforced Hybrid Fuzzy Rule-Based Neural Networks Driven to Inhomogeneous Neurons and Tournament Selection

Feature data-driven-reinforced fuzzy radial basis function neural network classifier with the aid of preprocessing techniques and particle swarm optimization

Reinforced Fuzzy Clustering-Based Ensemble Neural Networks

Rule-based Fuzzy Neural Networks Realized with the Aid of Linear Function Prototype-driven Fuzzy Clustering and Layer Reconstruction-based Network Design Strategy

Design of Reinforced Fuzzy Model Driven to Feature Selection Through Univariable-based Correlation and Multivariable-based Determination Coefficient Analysis

Design of Iterative Fuzzy Radial Basis Function Neural Networks Based on Iterative Weighted Fuzzy C-Means Clustering and Weighted LSE Estimation

Fuzzy Clustering-Based Neural Network Based on Linear Fitting Residual-Driven Weighted Fuzzy Clustering and Convolutional Regularization Strategy

Fuzzy clustering-based neural networks modelling reinforced with the aid of support vectors-based clustering and regularization technique

Design of Stabilized Fuzzy Relation-Based Neural Networks Driven to Ensemble Neurons/layers and Multi-Optimization

Reinforced Hybrid Interval Fuzzy Neural Networks Architecture: Design and Analysis

Design of Fuzzy Ensemble Architecture Realized with the Aid of FCM-Based Fuzzy Partition and NN with Weighted LSE Estimation

Design of double fuzzy clustering-driven context neural networks

Ensemble fuzzy radial basis function neural networks architecture driven with the aid of multi-optimization through clustering techniques and polynomial-based learning

Deep Neural Fuzzy System Oriented Toward High-Dimensional Data and Interpretable Artificial Intelligence

Fuzzy Nonlinear Regression with Fuzzified Radial Basis Function Network

Reinforced Fuzzy Clustering-Based Rule Model Constructed with the Aid of Exponentially Weighted ℓ2 Regularization Strategy and Augmented Random Vector Functional Link Network