Abstract:This study focuses on two critical design aspects of a progressive fuzzy polynomial neural network (PFPNN): the influence of the gated recurrent unit (GRU) structure and the implementation of fitness-based candidate neuron selection (FCNS) through two probabilistic strategies. The primary objectives are to enhance modeling accuracy and to reduce the computational load associated with nonlinear regression tasks. Compared with the existing fuzzy rule-based modeling architecture, the proposed dynamic model consists of the GRU structure and the hybrid fuzzy polynomial architecture. In the initial two layers of the PFPNN, we introduce three types of polynomial and fuzzy rules into the GRU neurons (GNs) and fuzzy polynomial neurons (FPNs), which can effectively reveal potential complex relationships in the data space. The synergy of the FCNS strategies and the ℓ 2 regularization learning method is to design a progressive regression model adept at melding the GRU structure with a self-organizing architecture. The proposed GRU structure and polynomial-based neurons significantly improve the modeling accuracy for time-series datasets. The rational utilization of FCNS strategies can reinforce the network structure and discover the potential performance of neurons of the network. Furthermore, the inclusion of ℓ 2 norm regularization provides additional stability to the proposed model and mitigates the overfitting issue commonly encountered in many existing learning methods. We validated the proposed neural networks using six time-series, four machine learning, and two real-world datasets. The PFPNN outperformed other models in the comparison studies in 83.3% of the datasets, emphasizing its superiority in terms of developing a stable deep structure from diverse candidate neurons and reducing computational overhead.

Probabilistic, Recurrent, Fuzzy Neural Network for Processing Noisy Time-Series Data

A Probabilistic Fuzzy Approach to Modeling Nonlinear Systems

Particle Filter Recurrent Neural Networks

Time Series Prediction Model Based on Non-Single Fuzzy Regular Network

Robust Stability and Robust Periodicity of Delayed Recurrent Neural Networks with Noise Disturbance

Exploiting Noise As a Resource for Computation and Learning in Spiking Neural Networks

Data Mining Using Dynamically Constructed Recurrent Fuzzy Neural Networks

Robust Fuzzy Neural Network With an Adaptive Inference Engine

A Fuzzy Neural Network For Intelligent Data Processing

Probabilistic Neural Networks for Incremental Learning over Time-Varying Streaming Data with Application to Air Pollution Monitoring

Design of Progressive Fuzzy Polynomial Neural Networks Through Gated Recurrent Unit Structure and Correlation/probabilistic Selection Strategies.

A Stochastic, Fuzzy, Neural Network for Unknown Dynamic Systems

A Novel Framework for Learning Stochastic Representations for Sequence Generation and Recognition

Time-Aware Fuzzy Neural Network Based on Frequency Enhanced Modulation Mechanism

Stochastic Fuzzy Neural Network and Its Robust Parameter Learning Algorithm

Robust Modeling for Industrial Process Based on Frequency Reconstructed Fuzzy Neural Network

A New Data-Driven Neural Fuzzy System with Collaborative Fuzzy Clustering Mechanism.

A Reservoir Computing Model Based on Nonlinear Spiking Neural P Systems for Time Series Forecasting

An Online Time Series Prediction Method and Its Application

Fuzzy Recurrent Stochastic Configuration Networks for Industrial Data Analytics

Identification and control of dynamic systems using recurrent fuzzy neural networks