Abstract:In the conventional Takagi-Sugeno-Kang (TSK)-type fuzzy models, constant or linear functions are usually utilized as the consequent parts of the fuzzy rules, but they cannot effectively describe the behavior within local regions defined by the antecedent parts. In this article, a theoretical and practical design methodology is developed to address this problem. First, the information granulation (Fuzzy C-Means) method is applied to capture the structure in the data and split the input space into subspaces, as well as form the antecedent parts. Second, the quadratic polynomials (QPs) are employed as the consequent parts. Compared with constant and linear functions, QPs can describe the input-output behavior within the local regions (subspaces) by refining the relationship between input and output variables. However, although QP can improve the approximation ability of the model, it could lead to the deterioration of the prediction ability of the model (e.g., overfitting). To handle this issue, we introduce an exponential weight approach inspired by the weight function theory encountered in harmonic analysis. More specifically, we adopt the exponential functions as the targeted penalty terms, which are equipped with l2 regularization (l2) (i.e., exponential weighted l2, ewl_2) to match the proposed reinforced second-order fuzzy rule-based model (RSFRM) properly. The advantage of el 2 compared to ordinary l2 lies in separately identifying and penalizing different types of polynomial terms in the coefficient estimation, and its results not only alleviate the overfitting and prevent the deterioration of generalization ability but also effectively release the prediction potential of the model.

A Modified Gradient Learning Algorithm with Smoothing L-1/2 Regularization for Takagi-Sugeno Fuzzy Models

A Modified Learning Method for First-order Takagi-Sugeno Fuzzy System: Gradient-based Neuro-fuzzy Algorithm Employing Smoothing Group Lasso Regularization

Batch Gradient Neuro-Fuzzy Learning Method with Smoothing L0 Regularization for the First-Order Takagi-Sugeno System

Smoothed L1/2 Regularizer Learning for Split-Complex Valued Neuro-Fuzzy Algorithm for TSK System and Its Convergence Results

Convergence of online gradient method for feedforward neural networks with smoothing L 1/2 regularization penalty

A Modified Gradient-Based Neuro-Fuzzy Learning Algorithm and Its Convergence

A Modified Higher-Order Feed Forward Neural Network with Smoothing Regularization

A Novel Neuro-fuzzy Learning Algorithm for First-Order Takagi–Sugeno Fuzzy Model: Caputo Fractional-Order Gradient Descent Method

Batch gradient method with smoothing L1/2 regularization for training of feedforward neural networks.

Online Gradient Method with Smoothing ℓ 0 Regularization for Feedforward Neural Networks

A New Conjugate Gradient Method with Smoothing $$L_{1/2} $$L1/2 Regularization Based on a Modified Secant Equation for Training Neural Networks

A New Conjugate Gradient Method with Smoothing L_1/2 Regularization Based on a Modified Secant Equation for Training Neural Networks

Feature Selection Using Smooth Gradient L1/2 Regularization

Convergence of Batch Gradient Learning Algorithm with Smoothing L1/2 Regularization for Sigma–Pi–Sigma Neural Networks

A Convergent Smoothing Algorithm for Training Max -Min Fuzzy Neural Networks.

A Modified Interval Type-2 Takagi-Sugeno Fuzzy Neural Network and Its Convergence Analysis

A Modifled Gradient-Based Neuro-Fuzzy Learning Algorithm for Pi-Sigma Network Based on First-Order Takagi-Sugeno System

Exponentially Weighted l_2 Regularization Strategy in Constructing Reinforced Second-order Fuzzy Rule-based Model

Feature Selection Using Smooth Gradient $$L_{1/2}$$ Regularization

A smoothing algorithm for training max-min neural networks.

Convergence Analyses on Sparse Feedforward Neural Networks Via Group Lasso Regularization.