Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task

Huiping Zhuang,Di Fang,Kai Tong,Yuchen Liu,Ziqian Zeng,Xu Zhou,Cen Chen

2024-05-28

Abstract:In the field of autonomous driving, even a meticulously trained model can encounter failures when faced with unfamiliar sceanrios. One of these scenarios can be formulated as an online continual learning (OCL) problem. That is, data come in an online fashion, and models are updated according to these streaming data. Two major OCL challenges are catastrophic forgetting and data imbalance. To address these challenges, in this paper, we propose an Analytic Exemplar-Free Online Continual Learning (AEF-OCL). The AEF-OCL leverages analytic continual learning principles and employs ridge regression as a classifier for features extracted by a large backbone network. It solves the OCL problem by recursively calculating the analytical solution, ensuring an equalization between the continual learning and its joint-learning counterpart, and works without the need to save any used samples (i.e., exemplar-free). Additionally, we introduce a Pseudo-Features Generator (PFG) module that recursively estimates the deviation of real features. The PFG generates offset pseudo-features following a normal distribution, thereby addressing the data imbalance issue. Experimental results demonstrate that despite being an exemplar-free strategy, our method outperforms various methods on the autonomous driving SODA10M dataset. Source code is available at <a class="link-external link-https" href="https://github.com/ZHUANGHP/Analytic-continual-learning" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Robotics

What problem does this paper attempt to address?

This paper attempts to solve the problem in the field of autonomous driving that even a well - trained model may fail when facing unfamiliar scenarios. Specifically, the paper proposes an improved method for the Online Continual Learning (OCL) problem, mainly addressing the following two challenges:

1. **Catastrophic Forgetting**: When the model acquires new information, it will gradually forget the knowledge learned before.
2. **Data Imbalance**: The amounts of data in different categories vary greatly, making it difficult for the model to perform continuous learning effectively.

To solve these problems, the paper proposes a method named "Analytic Exemplar - Free Online Continual Learning (AEF - OCL)". The following are the main features and contributions of this method:

- **AEF - OCL Algorithm**: Update the model weights by recursively calculating the analytical solution to ensure the equivalence between continuous learning and joint learning, thereby effectively avoiding catastrophic forgetting without saving any historical samples.

- **Pseudo - Features Generator (PFG) Module**: Recursively estimate the real feature distribution and generate offset pseudo - features that conform to the normal distribution to solve the data imbalance problem. The PFG module generates pseudo - data according to the distribution of the current task features, making the training data more balanced.

- **Theoretical Proof**: It is theoretically proven that AEF - OCL realizes the equivalence between the continuous learning structure and the joint learning structure by using the method of training all data together.

- **Application and Experiment**: Apply AEF - OCL to large - scale pre - trained models to solve the continuous learning tasks in the field of autonomous driving. The experimental results show that on the SODA10M dataset, AEF - OCL performs excellently in dealing with OCL challenges. Although it is an exemplar - free method, its performance is better than most replay - based methods.

In summary, this paper aims to solve the problems of catastrophic forgetting and data imbalance in online continuous learning in the field of autonomous driving by proposing the AEF - OCL method, thereby improving the adaptability and robustness of the model in complex and changeable environments.