Recurrent SOLAR algorithm

K. Demura,Y. Anzai,M. Kajiura
DOI: https://doi.org/10.1002/scj.4690271109
Systems and Computers in Japan
Abstract:This paper proposes the Recurrent SOLAR (Supervised One-shot Learning Algorithm for Real number inputs) algorithm, that can complete learning by a single presentation of analog time series data. The most remarkable feature of the Recurrent SOLAR is the one-shot learning, which has been difficult in the past modes, and which can be completed with a high speed by a single presentation of the time-series input data composed of real numbers. The basic idea of the Recurrent SOLAR is the same as in the context model. The time is considered as discrete, and the connection weight of the feedback loop from the output unit or the hidden unit to the state units is fixed. Consequently, the recurrent network can be considered as a feed-forward network. The backpropagation algorithm is used in the context model, while the SOLAR algorithm is applied to the Recurrent SOLAR, which is the one-shot learning algorithm based on the pattern recognition theory. By the use of the SOLAR algorithm, the Recurrent SOLAR can learn the analog time-series data by a single presentation without falling in a local minimum even for large-scale data. In other words, it is a learning algorithm that is suited to an environment where high speed is required in the learning.
What problem does this paper attempt to address?