Abstract:<p>In traditional hierarchical fuzzy classifiers, there exist some main problems. These issues include the output of the previous layer influencing with the input of the next layers, the inconsistency between the intra-layer and inter-layer, and the improvement of global optimization. Based on the above matters, a novel quantitative-integration-based hierarchical Takagi-Sugeno-Kang (TSK) is proposed to figure out the challenges in existing hierarchical fuzzy classifiers. As a novel hierarchical structure, the proposed classifier is built in a stacked manner. Each base building unit consists of an optimized zero-order TSK fuzzy classifier. For good interpretability of each base building unit, the antecedent parameters are solved by random selections of input features, random combinations of fuzzy rules, divisions of fuzzy partitions and generations of cluster centers. In addition, an improved method based on classical ridge regression is proposed to solve the problem of the consistency between in-layer and inter-layer. In order to enhance the classification performance of the fuzzy classifier, the input of each layer is optimized to effectively resolve the problem that the output of the previous layer affects the input of the next base building unit. Moreover, a method that randomly selects a part of the sample from the original training set is adopted to open the manifold structure of input set. Furthermore, the experimental results indicate that this method can indeed make the QI-TSK-FC fuzzy classifier obtain good classification performance. To improve the generalization ability of the fuzzy classifier, a method that quantitatively solves the integrated output is considered so that the QI-TSK-FC model can quickly obtain the satisfactory optimal solution. Finally, the classification performance and interpretability of the proposed fuzzy classifier are verified through the MIT-BIH sleep datasets.</p>

Layer Normalization for TSK Fuzzy System Optimization in Regression Problems

Fuzzy Knowledge Distillation from High-Order TSK to Low-Order TSK

Optimize TSK Fuzzy Systems for Regression Problems: Mini-Batch Gradient Descent with Regularization, DropRule and AdaBound (MBGD-RDA)

TKS-BLS: Temporal Kernel Stationary Broad Learning System for Enhanced Modeling, Anomaly Detection, and Incremental Learning with Application to Ironmaking Processes

FCM-RDpA: TSK fuzzy regression model construction using fuzzy C-means clustering, regularization, Droprule, and Powerball Adabelief

Implementation of Takagi Sugeno Kang Fuzzy with Rough Set Theory and Mini-Batch Gradient Descent Uniform Regularization

A Concise TSK Fuzzy Ensemble Classifier Integrating Dropout and Bagging for High-dimensional Problems

PyTSK: A Python Toolbox for TSK Fuzzy Systems

Normalized Activation Function: Toward Better Convergence

Convergence analysis of sparse TSK fuzzy systems based on spectral Dai-Yuan conjugate gradient and application to high-dimensional feature selection

Understanding and Improving Layer Normalization

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes

Rethinking Residual Connection with Layer Normalization

Quantitative-integration-based TSK fuzzy classification through improving the consistency of multi-hierarchical structure

Rethinking Skip Connection with Layer Normalization in Transformers and ResNets

Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel

Manifold-regularized Multitask Fuzzy System Modeling with Low-rank and Sparse Structures in Consequent Parameters

Broad Learning Based Dynamic Fuzzy Inference System with Adaptive Structure and Interpretable Fuzzy Rules

Takagi-Sugeno-Kang Fuzzy System Fusion: A Survey at Hierarchical, Wide and Stacked Levels

Path-BN - Towards effective batch normalization in the Path Space for ReLU networks.

A Novel Neuro-fuzzy Learning Algorithm for First-Order Takagi–Sugeno Fuzzy Model: Caputo Fractional-Order Gradient Descent Method