Shrinking-Magnifying Approach: New Exploration For Generalizing Neural Networks

Naiqin Feng,Jiucheng Xu,Yuhui Qiu,Yali Ji,Fang Wang,Jian Zou
2007-01-01
Abstract:In this paper, a new approach, "shrinking-magnifying approach"(SMA), to improving the generalization ability of neural networks is presented. Based on the fuzzy systems theory, and enlightened by the screen effect, this approach reduces the difference between training set and test set (or near pattern). by shrinking or magnifying the input vector so as to improve the generalization ability of neural networks. At the same time, a new algorithm - alpha-algorithm, which can obtain the appropriate shrinking-magnifying factor a and better generalization ability of neural networks is presented. Quite a few simulation experiments serve to illustrate the effects of SMA and alpha-algorithm. The results of experiments and analysis indicate that the new approach is not only simple and easy, but also very effective to many neural networks and classification problems. The experiments also show that the improved rate of the approach is up to 80 similar to 90%. It is proved to be a very good approach for improving the generalization ability of neural networks.
What problem does this paper attempt to address?