A Margin Maximization Training Algorithm for BP Network

Kai Wang,Qingren Wang
DOI: https://doi.org/10.1007/978-3-540-72393-6_49
2007-01-01
Abstract:Generalization problem is a key problem in NN society, which can be grouped into two classes: the generalization problem with unlimited size of training sample and that with limited size of training sample. The generalization problem with limited size of training sample is considered in this paper. Similar to margin maximization criterion in SVM, we propose a margin maximization training algorithm for BP network to further improve the generalization ability of BP network. Experimental results show that the margin maximization training algorithm proposed in this paper does improve the performance of BP network, and shows a comparable performance with SVM.
What problem does this paper attempt to address?