Abstract:In this study, we introduce a novel category of double fuzzy clustering-driven context neural networks (DFCCNNs). The study is focused on the development of advanced design methodologies for redesigning the structure of conventional fuzzy clustering-based neural networks. The conventional fuzzy clustering-based neural networks typically focus on dividing the input space into several local spaces (implied by clusters). In contrast, the proposed DFCCNNs take into account two distinct local spaces called context and cluster spaces, respectively. Cluster space refers to the local space positioned in the input space whereas context space concerns a local space formed in the output space. Through partitioning the output space into several local spaces, each context space is used as the desired (target) local output to construct local models. To complete this, the proposed network includes a new context layer for reasoning about context space in the output space. In this sense, Fuzzy C-Means (FCM) clustering is useful to form local spaces in both input and output spaces. The first one is used in order to form clusters and train weights positioned between the input and hidden layer, whereas the other one is applied to the output space to form context spaces. The key features of the proposed DFCCNNs can be enumerated as follows: (i) the parameters between the input layer and hidden layer are built through FCM clustering. The connections (weights) are specified as constant terms being in fact the centers of the clusters. The membership functions (represented through the partition matrix) produced by the FCM are used as activation functions located at the hidden layer of the "conventional" neural networks. (ii) Following the hidden layer, a context layer is formed to approximate the context space of the output variable and each node in context layer means individual local model. The outputs of the context layer are specified as a combination of both weights formed as linear function and the outputs of the hidden layer. The weights are updated using the least square estimation (LSE)-based method. (iii) At the output layer, the outputs of context layer are decoded to produce the corresponding numeric output. At this time, the weighted average is used and the weights are also adjusted with the use of the LSE scheme. From the viewpoint of performance improvement, the proposed design methodologies are discussed and experimented with the aid of benchmark machine learning datasets. Through the experiments, it is shown that the generalization abilities of the proposed DFCCNNs are better than those of the conventional FCNNs reported in the literature.

Fuzzy Clustering-Based Neural Network Based on Linear Fitting Residual-Driven Weighted Fuzzy Clustering and Convolutional Regularization Strategy

Fuzzy clustering-based neural networks modelling reinforced with the aid of support vectors-based clustering and regularization technique

Reinforced Fuzzy Clustering-Based Ensemble Neural Networks

Rule-based Fuzzy Neural Networks Realized with the Aid of Linear Function Prototype-driven Fuzzy Clustering and Layer Reconstruction-based Network Design Strategy

Incremental Fuzzy Clustering-Based Neural Networks Driven with the Aid of Dynamic Input Space Partition and Quasi-Fuzzy Local Models

Deep Fuzzy Clustering Network With Matrix Norm Regularization

Design of double fuzzy clustering-driven context neural networks

Adaptive Clustering Neural Network Based on Fuzzy Covariance Matrix

Design of Fuzzy Ensemble Architecture Realized with the Aid of FCM-Based Fuzzy Partition and NN with Weighted LSE Estimation

Reinforced Interval Type-2 Fuzzy Clustering-based Neural Network Realized Through Attention-based Clustering Mechanism and Successive Learning

Design of Reinforced Fuzzy Radial Basis Function Neural Network Classifier Driven With the Aid of Iterative Learning Techniques and Support Vector-Based Clustering

Reinforced Fuzzy Rule-based Neural Networks Realized Through Streamlined Feature Selection Strategy and Fuzzy Clustering with Distance Variation

A multiple neural network architecture based on fuzzy C-means clustering algorithm

HCFNN: High-order Coverage Function Neural Network for Image Classification

A Feature Clustering-Based Adaptive Modular Neural Network for Nonlinear System Modeling

Selforganizing Hybrid Fuzzy Polynomial Neural Network Classifier Driven Through Dynamically Adaptive Structure and Compound Regularization Technique

Nonstationary fuzzy neural network based on FCMnet clustering and a modified CG method with Armijo-type rule

Ensemble fuzzy radial basis function neural networks architecture driven with the aid of multi-optimization through clustering techniques and polynomial-based learning

Fuzzy Clustering Neural Networks Based on Statistical Tests

Designing a Fuzzy Adaptive Neural Network Leveraging a Feature Self-Enhancement Unit and Statistical Selection Methods

AN ASYMMETRIC ROBUST LEARNING ALGORITHM OF FUZZY CLUSTERING NEURAL NETWORKS