Abstract:In radial basis function neural network (RBFNN) based real-time learning tasks, forgetting mechanisms are widely used such that the neural network can keep its sensitivity to new data. However, with forgetting mechanisms, some useful knowledge will get lost simply because they are learned a long time ago, which we refer to as the passive knowledge forgetting phenomenon. To address this problem, this paper proposes a real-time training method named selective memory recursive least squares (SMRLS) in which the classical forgetting mechanisms are recast into a memory mechanism. Different from the forgetting mechanism, which mainly evaluates the importance of samples according to the time when samples are collected, the memory mechanism evaluates the importance of samples through both temporal and spatial distribution of samples. With SMRLS, the input space of the RBFNN is evenly divided into a finite number of partitions and a synthesized objective function is developed using synthesized samples from each partition. In addition to the current approximation error, the neural network also updates its weights according to the recorded data from the partition being visited. Compared with classical training methods including the forgetting factor recursive least squares (FFRLS) and stochastic gradient descent (SGD) methods, SMRLS achieves improved learning speed and generalization capability, which are demonstrated by corresponding simulation results.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is **how the Radial Basis Function Neural Network (RBFNN) can simultaneously maintain sensitivity to new data and suppress the phenomenon of passive knowledge forgetting in real - time learning tasks**. Specifically, although the existing forgetting mechanisms improve the sensitivity of neural networks to new data, they also lead to the forgetting of old data, thus affecting knowledge accumulation and generalization ability. To overcome this problem, the paper proposes a new real - time training method - Selective Memory Recursive Least Squares (SMRLS). ### Main Problems 1. **Phenomenon of Passive Knowledge Forgetting**: - Existing forgetting mechanisms (such as Forgetting Factor Recursive Least Squares, FFRLS) improve sensitivity to new data by reducing the weights of past samples, but this approach will cause useful knowledge to be forgotten over time. - This phenomenon is called **passive knowledge forgetting**, which will hinder the knowledge accumulation of neural networks. 2. **Sensitivity and Generalization Ability in Real - Time Learning**: - Real - time learning tasks require neural networks to be able to quickly adapt to new data while maintaining the memory of the learned knowledge. - Existing methods often sacrifice generalization ability and learning speed while increasing sensitivity. ### Solutions The Selective Memory Recursive Least Squares (SMRLS) proposed in the paper solves the above problems in the following ways: 1. **Memory Mechanism**: - Different from the traditional forgetting mechanism, SMRLS introduces a memory mechanism, which considers not only the time distribution of samples but also their spatial distribution. - The input space is evenly divided into multiple partitions, and the samples in each partition are synthesized into a synthetic sample for updating the weights of the neural network. 2. **Composite Objective Function**: - SMRLS defines a composite objective function, which considers not only the current approximation error but also the recorded data. - In this way, SMRLS can suppress the phenomenon of passive knowledge forgetting while maintaining sensitivity to new data. 3. **Recursive Optimization**: - The paper derives in detail the recursive optimization algorithm of SMRLS to ensure efficient updating of the neural network weights at each sampling. ### Advantages 1. **Learning Speed**: - Since the phenomenon of passive knowledge forgetting is suppressed, SMRLS can learn new data more quickly. 2. **Generalization Ability**: - The uniform distribution of synthetic samples in the input space reduces the inconsistency between the training set and the test set, thereby improving the generalization ability. 3. **Accuracy**: - The accuracy of SMRLS depends on the density of partitions. Appropriate design of the number of partitions can balance learning speed and accuracy. ### Application Prospects - **Long - term Real - Time Learning Tasks**: SMRLS is suitable for real - time learning tasks that require long - term knowledge accumulation. - **Other Linear Parameterized Approximators**: SMRLS can be used not only for the training of RBFNN but also extended to the parameter update of other linear parameterized approximators, such as polynomials, autoregressive models and single - layer feedforward networks. - **Neural Network Control, System Identification and Machine Learning**: SMRLS has broad application prospects in these fields. Through these improvements, SMRLS performs excellently in real - time learning tasks, can effectively solve the problem of passive knowledge forgetting in existing methods, and improve learning speed and generalization ability.

Selective Memory Recursive Least Squares: Recast Forgetting into Memory in RBF Neural Network Based Real-Time Learning

Real-Time Progressive Learning: Mutually Reinforcing Learning and Control with Neural-Network-Based Selective Memory

Real-Time Progressive Learning: Accumulate Knowledge from Control with Neural-Network-Based Selective Memory

Memory Recall: A Simple Neural Network Training Framework Against Catastrophic Forgetting

Learning with Recoverable Forgetting

Low-complexity Correlated Time-Averaged Variable Forgetting Factor Mechanism for Diffusion RLS Algorithm in Sensor Networks

Reinforcement Learning with Fast and Forgetful Memory

Dynamic Forgetting Krls For Online Time Series Prediction

Learning by Active Forgetting for Neural Networks

Slowing Down Forgetting in Continual Learning

A neural network model of retrieval-induced forgetting.

Example forgetting and rehearsal in continual learning

Learn to Forget: Memorization Elimination for Neural Networks.

Lifelong Learning and Selective Forgetting via Contrastive Strategy

Measuring Catastrophic Forgetting in Neural Networks

Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping

Generalized Forgetting Recursive Least Squares: Stability and Robustness Guarantees

Memory Aware Synapses: Learning what (not) to forget

Few-Shot Self Reminder to Overcome Catastrophic Forgetting

Adaptive Memory Replay for Continual Learning

Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning