Abstract:In real-world applications, robotic systems collect vast amounts of new data from ever-changing environments over time. They need to continually interact and learn new knowledge from the external world to adapt to the environment. Particularly, lifelong object recognition in an online and interactive manner is a crucial and fundamental capability for robotic systems. To meet this realistic demand, in this article, we propose an online active continual learning (OACL) framework for robotic lifelong object recognition, in the scenario of both classes and domains changing with dynamic environments. First, to reduce the labeling cost as much as possible while maximizing the performance, a new online active learning (OAL) strategy is designed by taking both the uncertainty and diversity of samples into account to protect the information volume and distribution of data. In addition, to prevent catastrophic forgetting and reduce memory costs, a novel online continual learning (OCL) algorithm is proposed based on the deep feature semantic augmentation and a new loss-based deep model and replay buffer update, which can mitigate the class imbalance between the old and new classes and alleviate confusion between two similar classes. Moreover, the mistake bound of the proposed method is analyzed in theory. OACL allows robots to select the most representative new samples to query labels and continually learn new objects and new variants of previously learned objects from a nonindependent and identically distributed (i.i.d.) data stream without catastrophic forgetting. Extensive experiments conducted on real lifelong robotic vision datasets demonstrate that our algorithm, even trained with fewer labeled samples and replay exemplars, can achieve state-of-the-art performance on OCL tasks.

The Empirical Impact of Forgetting and Transfer in Continual Visual Odometry

Progressive Learning without Forgetting

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization

Rethinking Continual Learning for Autonomous Agents and Robots

Predictive Experience Replay for Continual Visual Control and Forecasting

Learn to Memorize and to Forget: A Continual Learning Perspective of Dynamic SLAM

Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping

Preventing Catastrophic Forgetting through Memory Networks in Continuous Detection

Continual Learning through Human-Robot Interaction -- Human Perceptions of a Continual Learning Robot in Repeated Interactions

Continual Predictive Learning from Videos

Task-unaware Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation

Continual Lifelong Learning with Neural Networks: A Review

Proper Reuse of Features Extractor for Real-time Continual Learning

Online Active Continual Learning for Robotic Lifelong Object Recognition

Encoding Primitives Generation Policy Learning for Robotic Arm to Overcome Catastrophic Forgetting in Sequential Multi-Tasks Learning.

SynapNet: A Complementary Learning System Inspired Algorithm With Real-Time Application in Multimodal Perception

Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization Networks

Continual Learning Through Retrieval and Imagination.

Embodiment dictates learnability in neural controllers

Optimal Policy Replay: A Simple Method to Reduce Catastrophic Forgetting in Target Incremental Visual Navigation