Dynamic fuzzy neural networks-a novel approach to function approximation

WuShiqian,ErMeng Joo

2000-01-01

Abstract:In this paper, an architecture of dynamic fuzzy neural networks (D-FNN) implementing Takagi-Sugeno-Kang (TSK) fuzzy systems based on extended radial basis function (RBF) neural networks is proposed...

What problem does this paper attempt to address?

A neurofuzzy network structure for nonlinear system modeling

Yi Zhang,Jiau Chu,JinChang Gao

DOI: https://doi.org/10.1016/S1474-6670(17)56896-2

1999-01-01

IFAC Proceedings Volumes

Abstract:Abstract A fuzzy system has been shown capable of arbitrarily approximating any nonlinear function, and has been successfully applied to system modeling together with an RBF network used for compensation. B-spline basis functions have many desirable numerical properties and as such is used as membership functions of fuzzy system in this paper. The training algorithm is very simple since the network is linear in weights. RBF nets are local in nature, so they are suitable to compensate local errors two simulated examples are also given to illustrate the approaches
Fuzzy RBF Neural Network Based Function Approximation

LIU Kun,YAN Gangfeng

DOI: https://doi.org/10.3969/j.issn.1000-3428.2001.02.028

2001-01-01

Abstract:In this paper we present a fuzzy RBF neural network in which the knowledge expression of fuzzy logic is combined with fast learning speed and generalization of RBF neural network. Its structure and parameters can be adjusted according to the real problem. Simulation shows its fast learning speed and approximation accuracy.
A combination of traditional time series forecasting models with fuzzy learning neural networks

Chang-Yang Wen,Min Yao

DOI: https://doi.org/10.1109/ICMLC.2002.1176700

2002-01-01

Abstract:Discusses a combined model of three traditional time series forecasting (TSF) models, which involves a regression model, an exponential smoothing model and a gray forecasting model, using neural networks (NNs) to assemble them based on a fuzzy learning algorithm. Finally we represent an example of a TSF financial application in telecom enterprises to show its improvement in forecasting accuracy.
A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

李艳君,吴铁军,赵明旺

DOI: https://doi.org/10.3321/j.issn:1000-6788.2001.03.012

2001-01-01

Abstract:Based on the combination of genetic algorithms and orthogonaloptimum see king method, along with the modification of the width of the radial basis functi on (RBF) a novel nonlinear dynamic system modeling approach is proposed to correctly determine the centers of the RBF. This approach has great ly improved the generalization and robustness of the RBF neural network. Simulat ion shows that the improved neural network has successfully modeled the continuo us flow stirred tank reactor system.
Product Cost Estimation Based on Dynamic Fuzzy Neural Network

ZHAO Liang,HU Xu-xiao,PAN Shuang-xia,CHANG Yan,FENG Pei-en

DOI: https://doi.org/10.3785/j.issn.1008-973x.2006.02.027

2006-01-01

Abstract:A new dynamic fuzzy neural network(DFNN) was proposed based on neural network and fuzzy engineering according to the mathematical expression of cost estimation.To resolve the problem of little information provided and the big grain degree of cost estimation in the product conception design process.DFNN is dynamic in the learning process due to the continual shift of the number of recessive layers and dimensions based on the fuzzy knowledge.After analyzing the learning process and fuzzy knowledge of DFNN,DFNN dynamic arithmetic methods of DFNN were presented including layer dynamic,dimension dynamics and function dynamics. DFNN was used to estabish the framework of cost estimation and the cost model for product conception design were established.The developed corresponding software based on DFNN was proved to has more powerful information dealing ability through examples of an excavator boom an oil crock.The DFNN also improves the flexibility of the cost estimation model.
Approximation Capability of a Novel Neural Network Model for Dynamic Systems

Jianhai Zhang,Wanzeng Kong,Senlin Zhang,Meiqin Liu

DOI: https://doi.org/10.1109/icicta.2009.23

2009-01-01

Abstract:The approximation power for dynamic systems of a novel neural network model-standard neural network model (SNNM) is examined. Applying Stone-Weierstrass theorem, it is proved that SNNM is capable of approximating dynamic systems to any degree of accuracy. Furthermore, the results are briefly extended for any bounded measurable functions. The approximation capability together with the learn ability justify the use of SNNM in practical applications.
T-S fuzzy models based approximation for general fractional order nonlinear dynamic systems

Yong Wang,Yiheng Wei,Min Zhu,Mengmeng Liu,Cheng Peng,Zeshao Chen

DOI: https://doi.org/10.1109/FUZZ-IEEE.2014.6891524

2014-01-01

Abstract:In this paper, a novel approach is presented to approximate the general fractional order nonlinear dynamic systems. Firstly, a generalized T-S fuzzy method is used to approximate the original models. Then a new method to approximate the fractional order T-S models is utilized, and obtain a series of integer order linear model. It is revealed for the first time that a general fractional order nonlinear system (FONS) can be approximated by a series of integer order linear models to any degree of accuracy on any compact set. Finally, numerical simulation results are provided to illustrate the effectiveness of the proposed approach.
Disjunctive Fuzzy Neural Networks: A New Splitting-Based Approach to Designing a T–S Fuzzy Model

Ning Wang,Witold Pedrycz,Wen Yao,Xiaoqian Chen,Yong Zhao

DOI: https://doi.org/10.1109/tfuzz.2020.3039371

IF: 12.253

2022-02-01

IEEE Transactions on Fuzzy Systems

Abstract:This article proposes a new network approach toward the implementation of Takagi–Sugeno (T–S) fuzzy models referred to as disjunctive fuzzy neural networks (DJFNNs). The proposed DJFNN involves a novel network architecture and a greedy learning algorithm. Being different from the existing grid-based and clustering-based network architectures, the proposed architecture adds an OR neural layer positioned between the fuzzification layer and the rule layer. In this way, the implied constraint between the number of rules and the number of fuzzy labels is excluded so that a curse of dimensionality can be overcome and more interpretable models are formed. Furthermore, inspired by the core algorithm for building a decision tree, a top–down, nonbacktracking, and greedy algorithm is proposed to learn the unknown parameters of the networks. The input space splits into smaller and smaller subspace along the predefined fuzzy grids in a supervised manner meanwhile the associated conditions of the T–S fuzzy model are identified. The greedy algorithm is applicable to high-dimensional problems since there is no exponential growth in time or space as the dimensionality increases. The new network architecture and greedy learning algorithm make the proposed DJFNN a regression model of high interpretability and good prediction capability, particularly suitable for solving the high-dimensional problems. The DJFNN was experimented with using a synthetic dataset and 28 real-world datasets and compared with classical and state-of-the-art methods through nonparametric statistical tests. The results confirmed the effectiveness of the DJFNN in terms of accuracy, interpretability, and computational cost.

computer science, artificial intelligence,engineering, electrical & electronic
Fuzzy Recurrent Stochastic Configuration Networks for Industrial Data Analytics

Dianhui Wang,Gang Dang

2024-08-13

Abstract:This paper presents a novel neuro-fuzzy model, termed fuzzy recurrent stochastic configuration networks (F-RSCNs), for industrial data analytics. Unlike the original recurrent stochastic configuration network (RSCN), the proposed F-RSCN is constructed by multiple sub-reservoirs, and each sub-reservoir is associated with a Takagi-Sugeno-Kang (TSK) fuzzy rule. Through this hybrid framework, first, the interpretability of the model is enhanced by incorporating fuzzy reasoning to embed the prior knowledge into the network. Then, the parameters of the neuro-fuzzy model are determined by the recurrent stochastic configuration (RSC) algorithm. This scheme not only ensures the universal approximation property and fast learning speed of the built model but also overcomes uncertain problems, such as unknown dynamic orders, arbitrary structure determination, and the sensitivity of learning parameters in modelling nonlinear dynamics. Finally, an online update of the output weights is performed using the projection algorithm, and the convergence analysis of the learning parameters is given. By integrating TSK fuzzy inference systems into RSCNs, F-RSCNs have strong fuzzy inference capability and can achieve sound performance for both learning and generalization. Comprehensive experiments show that the proposed F-RSCNs outperform other classical neuro-fuzzy and non-fuzzy models, demonstrating great potential for modelling complex industrial systems.

Machine Learning,Artificial Intelligence,Neural and Evolutionary Computing
Fuzzy identification and controller based on generalized fuzzy radial basis function networks

Xinghu Zhang,Chang-Chieh Hang,Shaohua Tan,Pei-Zhuang Wang

DOI: https://doi.org/10.1109/FUZZY.1995.409687

1995-01-01

Abstract:This paper first proposes a new kind of fuzzy neural networks-generalized fuzzy radial basis function networks (f-RBF), which combines the fuzzifying and defuzzifying processes into a united network structure. We then give the dynamic training rule and training strategy for the f-RBF. We further discuss several special features of this kind of networks that conventional neural networks do not have, and conclude that it can process both the fuzzy-valued and real-valued data simultaneously, and can achieve the minimum realization of fuzzy controller for nonlinear systems. Finally, using the f-RBF, we design a fuzzy controller for a nonlinear system regulation. Furthermore, we point out that any nonlinear control u can be decomposed into three parts: a fuzzy control uf, a linear control ul, and an error compensation ue, i.e., u=uf+ul +ue. The stability of the closed-loop system is also analyzed using sliding control techniques
Broad Learning Based Dynamic Fuzzy Inference System with Adaptive Structure and Interpretable Fuzzy Rules

Kaiyuan Bai,Xiaomin Zhu,Shiping Wen,Runtong Zhang,Wenyu Zhang

DOI: https://doi.org/10.1109/tfuzz.2021.3112222

IF: 12.253

2021-01-01

IEEE Transactions on Fuzzy Systems

Abstract:This article investigates the feasibility of applying the broad learning system (BLS) to realize a novel Takagi–Sugeno–Kang (TSK) neuro-fuzzy model, namely a broad learning based dynamic fuzzy inference system (BL-DFIS). It not only improves the accuracy and interpretability of neuro-fuzzy models but also solves the challenging problem that models are incapable of determining the optimal architecture autonomously. BL-DFIS first accomplishes a TSK fuzzy system under the framework of BLS, in which an extreme learning machine auto-encoder is employed to obtain feature representation in a fast and analytical way, and an interpretable linguistic fuzzy rule is integrated into the enhancement node to ensure the high interpretability of the system. Meanwhile, the extended-enhancement unit is designed to achieve the first-order TSK fuzzy system. In addition, a dynamic incremental learning algorithm with internal pruning and updating mechanism is developed for the learning of BL-DFIS, which enables the system to automatically assemble the optimal structure to obtain a compact rule base and an excellent classification performance. Experiments on benchmark datasets demonstrate that the proposed BL-DFIS can achieve a better classification performance than some state-of-the-art nonfuzzy and neuro-fuzzy methods, simultaneously using the most parsimonious model structure.

computer science, artificial intelligence,engineering, electrical & electronic
Complex Systems Modeling Using Dynamic Fuzzy Neural Networks

DP Kwok,ZD Deng,DQ Sun

DOI: https://doi.org/10.1109/fuzzy.1998.686277

1998-01-01

Abstract:Presents a dynamic fuzzy neural network (DFNN) for complex systems modeling. Using PID operator input layers, the DFNN network can be adopted to directly represent nonlinear continuous-time dynamic processes of unknown order and structure. The rationale is based on the fact that under a certain condition a nonlinear dynamic system can be approximated by a nonlinear combination of PID operators or a nonlinear PID system through learning processes. The dynamic network architecture and the competitive and supervised learning algorithms are given. Numerical examples are provided to illustrate the approximating ability of the proposed network for the inverse modeling of pH-neutralization processes
Approximation Capability to Functions of Several Variables, Nonlinear Functionals and Operators by Radial Basis Function Neural Networks

TP CHEN,H CHEN

DOI: https://doi.org/10.1109/72.392252

1995-01-01

IEEE Transactions on Neural Networks

Abstract:The purpose of this paper is to explore the representation capability of radial basis function (RBF) neural networks. The main results are: 1) the necessary and sufficient condition for a function of one variable to be qualified as an activation function in RBF network is that the function is not an even polynomial, and 2) the capability of approximation to nonlinear functionals and operators by RBF networks is revealed, using sample data either in frequency domain or in time domain, which can be used in system identification by neural networks
Self-tuning and approximation via RBF neural networks

Wenqing Ni,Shuicao Zheng,Guowei Lei,Linyang Xie

DOI: https://doi.org/10.1145/3580219.3580233

2023-01-28

Abstract:Radial Basis Function (RBF) is fit for real-time control task owing to its fast speed of learning by avoiding the local minimum problem. Moreover, RBF network can ensure the accuracy in control system owing to its robustness and adaptability. Up to now, the characters of RBF still need to be studied on how to improve the performance. In the paper, fuzzy RBF neural network and the combination with genetic algorithm are studied and simulated. In addition, RBF network is applied in self-tuning control system and validated

Engineering,Computer Science
T-S Fuzzy Systems Approach to Approximation and Robust Controller Design for General Nonlinear Systems

Qing Gao,Xiao-Jun Zeng,Gang Feng,Yong Wang

DOI: https://doi.org/10.1109/tsmcb.2012.2187442

2012-01-01

Abstract:This paper presents a novel approach to control general nonlinear systems based on Takagi-Sugeno (T-S) fuzzy dynamic models. It is first shown that a general nonlinear system can be approximated by a generalized T-S fuzzy model to any degree of accuracy on any compact set. It is then shown that the stabilization problem of the general nonlinear system can be solved as a robust stabilization problem of the developed T-S fuzzy system with the approximation errors as the uncertainty term. Based on a piecewise quadratic Lyapunov function, the robust semiglobal stabilization and H∞ control of the general nonlinear system are formulated in the form of linear matrix inequalities. Simulation results are provided to illustrate the effectiveness of the proposed approaches.
Modeling of Nonlinear Continous Time Dynamic System with Fuzzy Neural Networks

李冬梅,伞冶

DOI: https://doi.org/10.3321/j.issn:1001-0920.2003.06.005

2003-01-01

Abstract:A Runge-Kutta fuzzy neural network (RKFNN) is presented, which is appropriate for modeling a general nonlinear continuous time dynamic system. It is proved that RKFNN can approximate any nonlinear dynamics with any given precision. RKFNN that learns the changing rates of system states is constructed with the traditional Runge-Kutta integral equations, which solves the low precision problems of DMFNN learning systems states. For RKFNN learning, an online recursive algorithm is presented. It is shown experimentally that RKFNN is a better structure for modeling a nonlinear continuous time system.
On the Functional Equivalence of TSK Fuzzy Systems to Neural Networks, Mixture of Experts, CART, and Stacking Ensemble Regression

Dongrui Wu,Chin-Teng Lin,Jian Huang,Zhigang Zeng

DOI: https://doi.org/10.1109/tfuzz.2019.2941697

IF: 12.253

2020-10-01

IEEE Transactions on Fuzzy Systems

Abstract:Fuzzy systems have achieved great success in numerous applications. However, there are still many challenges in designing an optimal fuzzy system, e.g., how to efficiently optimize its parameters, how to balance the trade-off between cooperations and competitions among the rules, how to overcome the curse of dimensionality, how to increase its generalization ability, etc. Literature has shown that by making appropriate connections between fuzzy systems and other machine learning approaches, good practices from other domains may be used to improve the fuzzy systems, and vice versa. This article gives an overview on the functional equivalence between Takagi–Sugeno–Kang fuzzy systems and four classic machine learning approaches—neural networks, mixture of experts, classification and regression trees, and stacking ensemble regression—for regression problems. We also point out some promising new research directions, inspired by the functional equivalence, that could lead to solutions to the aforementioned problems. To our knowledge, this is so far the most comprehensive overview on the connections between fuzzy systems and other popular machine learning approaches, and hopefully will stimulate more hybridization between different machine learning algorithms.

computer science, artificial intelligence,engineering, electrical & electronic
Fuzzy-Membership-Kernel Learning Based on Takagi–Sugeno Models

DOI: https://doi.org/10.1007/s40815-024-01763-7

IF: 4.085

2024-06-12

International Journal of Fuzzy Systems

Abstract:A new class of kernels is constructed via incorporating fuzzy information into learning to enhance the performance of kernel-based algorithms. The fuzzy information is given in the form of Takagi–Sugeno (TS) models. First, a TS model is transformed into a structure that includes an inner product. Then an insensitive loss function is employed to identify the parameters in the consequent parts of TS fuzzy rules. By virtue of the kernel tick, the inner product is replaced with common kernels (e.g., Gaussian kernels) in the corresponding dual optimization problem. Consequently, the new kernels, called fuzzy membership kernels (FMKs), are constructed via TS models and common kernels. Note that some research focuses on transforming fuzzy rules into the weights of kernels, or simply, fuzzy weight kernels (FWK), for short. However, FWKs only consider the weights of training points and neglect the weights of test points. Compared with FWKs, the representations of FMKs show that the fuzzy information is incorporated into learning by adding weights to feature mappings of training and test points, respectively. Therefore, FMKs can overcome the shortcomings of FWKs. Finally, a function approximation problem is employed to validate the proposed approach.

computer science, information systems,automation & control systems, artificial intelligence
Adaptive Nonstationary Fuzzy Neural Network

Qin Chang,Zhen Zhang,Fanyue Wei,Jian Wang,Witold Pedrycz,Nikhil R. Pal

DOI: https://doi.org/10.1016/j.knosys.2024.111398

IF: 8.139

2024-01-30

Knowledge-Based Systems

Abstract:Fuzzy neural network (FNN) plays an important role as an inference system in practical applications. To enhance its ability of handling uncertainty without invoking high computational cost, and to take variations in rules into consideration as well, we propose a new inference framework—nonstationary fuzzy neural network (NFNN). This NFNN is composed of a series of zero-order TSK FNNs with the same structure but using slightly perturbed fuzzy sets in the corresponding neurons, which is inspired from the non-stationary fuzzy sets and can mimic the variation in human's decision-making process. In order to obtain a concise and adaptive rule base for NFNN, a modified affinity propagation (MAP) clustering method is proposed. The MAP can determine the number of rules in an adaptive manner, and is used to initialize the rule parameters of NFNN, which we call Adaptive NFNN (ANFNN). Numerical experiments have been carried out over 17 classification datasets and three regression datasets. The experimental results demonstrate that ANFNN exhibits better accuracy, generalization ability, and fault-tolerance ability compared with the classical type-1 fuzzy neural network. In 15 of the 17 classification datasets, ANFNN achieves the same or better accuracy performance compared to interval type-2 FNNs with about half time consumed. This work confirms the feasibility of integrating simple-structured type-1 TSK FNNs to achieve the performance of interval type-2 FNNs, and proves that ANFNN can be a more accurate and reliable alternative to classical type-1 FNN.

computer science, artificial intelligence
Fuzzy Multiple Hidden Layer Recurrent Neural Control of Nonlinear System Using Terminal Sliding-Mode Controller

Juntao Fei,Yun Chen,Lunhaojie Liu,Yunmei Fang

DOI: https://doi.org/10.1109/TCYB.2021.3052234

Abstract:This study designs a fuzzy double hidden layer recurrent neural network (FDHLRNN) controller for a class of nonlinear systems using a terminal sliding-mode control (TSMC). The proposed FDHLRNN is a fully regulated network, which can be simply considered as a combination of a fuzzy neural network (FNN) and a radial basis function neural network (RBF NN) to improve the accuracy of a nonlinear approximation, so it has the advantages of these two neural networks. The main advantage of the proposed new FDHLRNN is that the output values of the FNN and DHLRNN are considered at the same time, and the outer layer feedback is added to increase the dynamic approximation ability. FDHLRNN was designed to approximate the nonlinear sliding-mode equivalent control term to reduce the switching gain. To ensure the best approximation capability and control performance, the proposed FDHLRNN using TSMC is applied for the second-order nonlinear model. Two simulation examples are implemented to verify that the proposed FDHLRNN has faster convergence speed and the FDHLRNN with TSMC has good dynamic property and robustness, and a hardware experimental study with an active power filter proves the feasibility of the method.

Dynamic fuzzy neural networks-a novel approach to function approximation

A neurofuzzy network structure for nonlinear system modeling

Fuzzy RBF Neural Network Based Function Approximation

A combination of traditional time series forecasting models with fuzzy learning neural networks

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Product Cost Estimation Based on Dynamic Fuzzy Neural Network

Approximation Capability of a Novel Neural Network Model for Dynamic Systems

T-S fuzzy models based approximation for general fractional order nonlinear dynamic systems

Disjunctive Fuzzy Neural Networks: A New Splitting-Based Approach to Designing a T–S Fuzzy Model

Fuzzy Recurrent Stochastic Configuration Networks for Industrial Data Analytics

Fuzzy identification and controller based on generalized fuzzy radial basis function networks

Broad Learning Based Dynamic Fuzzy Inference System with Adaptive Structure and Interpretable Fuzzy Rules

Complex Systems Modeling Using Dynamic Fuzzy Neural Networks

Approximation Capability to Functions of Several Variables, Nonlinear Functionals and Operators by Radial Basis Function Neural Networks

Self-tuning and approximation via RBF neural networks

T-S Fuzzy Systems Approach to Approximation and Robust Controller Design for General Nonlinear Systems

Modeling of Nonlinear Continous Time Dynamic System with Fuzzy Neural Networks

On the Functional Equivalence of TSK Fuzzy Systems to Neural Networks, Mixture of Experts, CART, and Stacking Ensemble Regression

Fuzzy-Membership-Kernel Learning Based on Takagi–Sugeno Models

Adaptive Nonstationary Fuzzy Neural Network

Fuzzy Multiple Hidden Layer Recurrent Neural Control of Nonlinear System Using Terminal Sliding-Mode Controller