The delta rule and learning for min-max neural networks
Xinghu Zhang,Chang-Chieh Hang,Shaohua Tan,Pei-Zhuang Wang
DOI: https://doi.org/10.1109/ICNN.1994.374135
1994-01-01
Abstract:There have been a lot of works discussing (V, ∧)-neural network. However, because of the difficulty of mathematical analysis for (V, ∧)-functions, most previous works choose bounded-plus (+) and multiply (*) as the operations of V and ∧. The (V, ∧) neural network with operators (+, *) is much easier than the (V, ∧) neural network with some other operators, e.g. min-max operators, because it has little difference to a backpropagation neural network. In this paper, the authors choose min and max as the operation of V and ∧. Because of the difficulty of functions invoked with min and max operations, it is very difficult to deal with (V, ∧) neural networks with operators (min. max). In Section 1 of the paper, the authors first discuss the differentiations of (V, ∧)-functions, and get that “if f1(x), f2(x), ..., fn(n) are continuously differentiable in real number line ℜ, then any function h(x) generated from f1(x), f2(x), ..., fn (X) through finite times of (V, ∧) operations is continuously differentiable almost everywhere in ℜ”. This statement guarantees that the delta rule given in Section 2 is rational and effective. In Section 3 the authors implement a simple example to show that the delta rule given in Section 2 is capable to train (V, ∧) neural networks