Abstract:Multi-modal problems can be effectively addressed using multiple hypothesis frameworks, but integrating these frameworks into learning models poses significant challenges. This paper introduces a Structured Radial Basis Function Network (s-RBFN) as an ensemble of multiple hypothesis predictors for regression. During the training of the predictors, first the centroidal Voronoi tessellations are formed based on their losses and the true labels, representing geometrically the set of multiple hypotheses. Then, the trained predictors are used to compute a structured dataset with their predictions, including centers and scales for the basis functions. A radial basis function network, with each basis function focused on a particular hypothesis, is subsequently trained using this structured dataset for multiple hypotheses prediction. The s-RBFN is designed to train efficiently while controlling diversity in ensemble learning parametrically. The least-squares approach for training the structured ensemble model provides a closed-form solution for multiple hypotheses and structured predictions. During the formation of the structured dataset, a parameter is employed to avoid mode collapse by controlling tessellation shapes. This parameter provides a mechanism to balance diversity and generalization performance for the s-RBFN. The empirical validation on two multivariate prediction datasets-air quality and energy appliance predictions-demonstrates the superior generalization performance and computational efficiency of the structured ensemble model compared to other models and their single-hypothesis counterparts.

Multi-Model Rbf Network Modeling Based On Weighting Fuzzy Degree Of Membership

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

A neurofuzzy network structure for nonlinear system modeling

Multiplayer Recurrent Fuzzy Neural Network Modeling Based on Hybrid Chaotic Search Method

Splicing System Based Genetic Algorithms for Developing Rbf Networks Models

Cuckoo Search Algorithm with Membrane Communication Mechanism for Modeling Overhead Crane Systems Using RBF Neural Networks.

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Nonlinear adaptive control based on RBF networks and multi-model method

A Local Learning Algorithm for Random Weights Networks

Multiple Neural Network Model Based on Data Partition Using Feature Clustering

Functional Modelling of Large Scattered Data Sets Using Neural Networks

A Clustering Method And Its Application To The Modeling Of Rbf Networks

Nonlinear time series modeling and prediction using RBF network with improved clustering algorithm

A New Method for Decision on the Structure of RBF Neural Network

Structured Radial Basis Function Network: Modelling Diversity for Multiple Hypotheses Prediction

A two-level learning hierarchy for the radial basis function networks

An Efficient Deep Belief Network with Fuzzy Learning for Nonlinear System Modeling.

Research and application of RBF neural network based on modified Levenberg-Marquardt

A novel active learning method based on matrix-operation RBF model for high-dimensional reliability analysis

A Multiple-RBF Neural Network Model to Set Rolling Force Based on Wavelet Analysis

Research of Assembling Optimized Classification Algorithm by Neural Network Based on Ordinary Least Squares (OLS).