Abstract:In this study, we introduce a novel category of double fuzzy clustering-driven context neural networks (DFCCNNs). The study is focused on the development of advanced design methodologies for redesigning the structure of conventional fuzzy clustering-based neural networks. The conventional fuzzy clustering-based neural networks typically focus on dividing the input space into several local spaces (implied by clusters). In contrast, the proposed DFCCNNs take into account two distinct local spaces called context and cluster spaces, respectively. Cluster space refers to the local space positioned in the input space whereas context space concerns a local space formed in the output space. Through partitioning the output space into several local spaces, each context space is used as the desired (target) local output to construct local models. To complete this, the proposed network includes a new context layer for reasoning about context space in the output space. In this sense, Fuzzy C-Means (FCM) clustering is useful to form local spaces in both input and output spaces. The first one is used in order to form clusters and train weights positioned between the input and hidden layer, whereas the other one is applied to the output space to form context spaces. The key features of the proposed DFCCNNs can be enumerated as follows: (i) the parameters between the input layer and hidden layer are built through FCM clustering. The connections (weights) are specified as constant terms being in fact the centers of the clusters. The membership functions (represented through the partition matrix) produced by the FCM are used as activation functions located at the hidden layer of the "conventional" neural networks. (ii) Following the hidden layer, a context layer is formed to approximate the context space of the output variable and each node in context layer means individual local model. The outputs of the context layer are specified as a combination of both weights formed as linear function and the outputs of the hidden layer. The weights are updated using the least square estimation (LSE)-based method. (iii) At the output layer, the outputs of context layer are decoded to produce the corresponding numeric output. At this time, the weighted average is used and the weights are also adjusted with the use of the LSE scheme. From the viewpoint of performance improvement, the proposed design methodologies are discussed and experimented with the aid of benchmark machine learning datasets. Through the experiments, it is shown that the generalization abilities of the proposed DFCCNNs are better than those of the conventional FCNNs reported in the literature.

Fuzzy clustering-based neural networks modelling reinforced with the aid of support vectors-based clustering and regularization technique

Fuzzy Clustering-Based Neural Network Based on Linear Fitting Residual-Driven Weighted Fuzzy Clustering and Convolutional Regularization Strategy

Reinforced Fuzzy Clustering-Based Ensemble Neural Networks

Deep Fuzzy Clustering Network With Matrix Norm Regularization

Design of Reinforced Fuzzy Radial Basis Function Neural Network Classifier Driven With the Aid of Iterative Learning Techniques and Support Vector-Based Clustering

Fuzzy support vector clustering

Reinforced Interval Type-2 Fuzzy Clustering-based Neural Network Realized Through Attention-based Clustering Mechanism and Successive Learning

Reinforced Fuzzy Clustering-Based Rule Model Constructed with the Aid of Exponentially Weighted ℓ2 Regularization Strategy and Augmented Random Vector Functional Link Network

An information entropy-based fuzzy stochastic configuration network for robust data modeling

Rule-based Fuzzy Neural Networks Realized with the Aid of Linear Function Prototype-driven Fuzzy Clustering and Layer Reconstruction-based Network Design Strategy

Robust Subspace Clustering Network with Dual-Domain Regularization

A multiple neural network architecture based on fuzzy C-means clustering algorithm

Robust Fuzzy Clustering Neural Network Based on Epsilon-Insensitive Loss Function

Reinforced Fuzzy Rule-based Neural Networks Realized Through Streamlined Feature Selection Strategy and Fuzzy Clustering with Distance Variation

AN ASYMMETRIC ROBUST LEARNING ALGORITHM OF FUZZY CLUSTERING NEURAL NETWORKS

Robust Multi-Linear Fuzzy SVR Designed with the Aid of Fuzzy C-Means Clustering Based on Insensitive Data Information

A novel multiple neural networks modeling method based on FCM

Robust Jointly Sparse Fuzzy Clustering With Neighborhood Structure Preservation

Design of double fuzzy clustering-driven context neural networks

Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering

Adaptive Clustering Neural Network Based on Fuzzy Covariance Matrix