Abstract:Prior knowledge effectively mitigates low modeling accuracy when insufficient data exist. This idea has been confirmed in many fields, especially the transformation of prior knowledge into constraints, widely employed in Bayesian network (BN) parameter learning. The role of constraints in parameter learning is the focus of this study. If parameter learning results are blindly biased toward constraints, underfitting occurs, whereas the effectiveness of the constraint intervention is weak and can not mitigate overfitting by insufficient data. Therefore, fuzzy theory is introduced in parameter learning. The fuzzy membership function is applied to measure the interference effects of constraints and improve the interpretability and accuracy of the constraint usage. For the maximum a posteriori method, hyperparameters are utilized as virtual samples to realize the intervention of parameter learning. This study proposes a fuzzy maximum a posteriori (FMAP) method, in which the hyperparameter is adjusted to a suitable value using a fuzzy membership function. For the data extension method, a proper extension function is critical to the quality of the extended data. Therefore, this paper proposes a fuzzy bootstrap (FB) method that uses a fuzzy membership function to determine the distribution of the expansion parameters. The two algorithms presented in this paper are verified on 12 standard networks. The experimental results show that the proposed methods effectively improve the accuracy of parameter learning.

A new regularization learning method for improving generalization capability of neural network

A Novel Neural Network Learning Method for Dynamically Tuning Regularization Coefficient

Bayesian network parameter learning using fuzzy constraints.

Investigation on Improving Generalization of Neural Network

Generalize Deep Neural Networks with Adaptive Regularization for Classifying

Research on the Generalization Problem of BP Neural Network

A New Approach to Improving Generalization Ability of Feed-Foward Neural Networks

Neuron with Steady Response Leads to Better Generalization

A Backpropagation Learning Algorithm with Graph Regularization for Feedforward Neural Networks

A novel fuzzy neural network with fast training anal accurate generalization

An Efficient Optimization Method for Improving Generalization Performance of Fuzzy Neural Networks.

A Hybrid Regularization Approach for Random Vector Functional-Link Networks.

Revisiting Random Weight Perturbation for Efficiently Improving Generalization

Network as Regularization for Training Deep Neural Networks: Framework, Model and Performance

A Novel Fuzzy Neural Network with Fast Training and Accurate Generalization.

Improving Generalization Ability of Universal Learning Networks with Superfluous Parameters

Function-Space Regularization in Neural Networks: A Probabilistic Perspective

The Efficacy of Regularization in Two Layer Neural Networks

Improving Generalization of Meta-Learning with Inverted Regularization at Inner-Level

Feature Variance Regularization: A Simple Way to Improve the Generalizability of Neural Networks

Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning