Abstract:In the conventional Takagi-Sugeno-Kang (TSK)-type fuzzy models, constant or linear functions are usually utilized as the consequent parts of the fuzzy rules, but they cannot effectively describe the behavior within local regions defined by the antecedent parts. In this article, a theoretical and practical design methodology is developed to address this problem. First, the information granulation (Fuzzy C-Means) method is applied to capture the structure in the data and split the input space into subspaces, as well as form the antecedent parts. Second, the quadratic polynomials (QPs) are employed as the consequent parts. Compared with constant and linear functions, QPs can describe the input-output behavior within the local regions (subspaces) by refining the relationship between input and output variables. However, although QP can improve the approximation ability of the model, it could lead to the deterioration of the prediction ability of the model (e.g., overfitting). To handle this issue, we introduce an exponential weight approach inspired by the weight function theory encountered in harmonic analysis. More specifically, we adopt the exponential functions as the targeted penalty terms, which are equipped with l2 regularization (l2) (i.e., exponential weighted l2, ewl_2) to match the proposed reinforced second-order fuzzy rule-based model (RSFRM) properly. The advantage of el 2 compared to ordinary l2 lies in separately identifying and penalizing different types of polynomial terms in the coefficient estimation, and its results not only alleviate the overfitting and prevent the deterioration of generalization ability but also effectively release the prediction potential of the model.

Smoothed L1/2 Regularizer Learning for Split-Complex Valued Neuro-Fuzzy Algorithm for TSK System and Its Convergence Results

A Split-Complex Valued Gradient-Based Descent Neuro-Fuzzy Algorithm for TS System and Its Convergence

A Modified Gradient Learning Algorithm with Smoothing L-1/2 Regularization for Takagi-Sugeno Fuzzy Models

A Modified Learning Method for First-order Takagi-Sugeno Fuzzy System: Gradient-based Neuro-fuzzy Algorithm Employing Smoothing Group Lasso Regularization

Strong Convergence of Neuro-Fuzzy Learning with Adaptive Momentum for Complex System

Batch Gradient Neuro-Fuzzy Learning Method with Smoothing L0 Regularization for the First-Order Takagi-Sugeno System

Convergence of online gradient method for feedforward neural networks with smoothing L 1/2 regularization penalty

Convergence of Batch Gradient Learning Algorithm with Smoothing L1/2 Regularization for Sigma–Pi–Sigma Neural Networks

NSV attitude system fuzzy modeling based on modified L-M algorithm

Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems

Convergence analysis of sparse TSK fuzzy systems based on spectral Dai-Yuan conjugate gradient and application to high-dimensional feature selection

A Novel Neuro-fuzzy Learning Algorithm for First-Order Takagi–Sugeno Fuzzy Model: Caputo Fractional-Order Gradient Descent Method

Exponentially Weighted l_2 Regularization Strategy in Constructing Reinforced Second-order Fuzzy Rule-based Model

Convergence Analysis of Three Classes of Split-Complex Gradient Algorithms for Complex-Valued Recurrent Neural Networks

Convergence Analyses on Sparse Feedforward Neural Networks Via Group Lasso Regularization.

An Alternating Proximal Splitting Method With Global Convergence For Nonconvex Structured Sparsity Optimization

A Polak-Ribière-Polyak Conjugate Gradient-Based Neuro-Fuzzy Network and Its Convergence

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Regularization Methods for Separable Nonlinear Models

Takagi–Sugeno–Kang Fuzzy System Modeling Based On Low-Rank Sparse Subspace Learning For Motor Imagery Electroencephalogram Signal Classification

Layer Normalization for TSK Fuzzy System Optimization in Regression Problems