Abstract:In real-world applications, robotic systems collect vast amounts of new data from ever-changing environments over time. They need to continually interact and learn new knowledge from the external world to adapt to the environment. Particularly, lifelong object recognition in an online and interactive manner is a crucial and fundamental capability for robotic systems. To meet this realistic demand, in this article, we propose an online active continual learning (OACL) framework for robotic lifelong object recognition, in the scenario of both classes and domains changing with dynamic environments. First, to reduce the labeling cost as much as possible while maximizing the performance, a new online active learning (OAL) strategy is designed by taking both the uncertainty and diversity of samples into account to protect the information volume and distribution of data. In addition, to prevent catastrophic forgetting and reduce memory costs, a novel online continual learning (OCL) algorithm is proposed based on the deep feature semantic augmentation and a new loss-based deep model and replay buffer update, which can mitigate the class imbalance between the old and new classes and alleviate confusion between two similar classes. Moreover, the mistake bound of the proposed method is analyzed in theory. OACL allows robots to select the most representative new samples to query labels and continually learn new objects and new variants of previously learned objects from a nonindependent and identically distributed (i.i.d.) data stream without catastrophic forgetting. Extensive experiments conducted on real lifelong robotic vision datasets demonstrate that our algorithm, even trained with fewer labeled samples and replay exemplars, can achieve state-of-the-art performance on OCL tasks.

Learning Novel Objects Continually Through Curiosity

Rethinking Continual Learning for Autonomous Agents and Robots

Dynamic Neural Curiosity Enhances Learning Flexibility for Autonomous Goal Discovery

A Curiosity Algorithm for Robots Based on the Free Energy Principle

Continual Learning through Human-Robot Interaction -- Human Perceptions of a Continual Learning Robot in Repeated Interactions

Self-supervised Continual Learning for Object Recognition in Image Sequences

Meta-learning curiosity algorithms

Online Active Continual Learning for Robotic Lifelong Object Recognition

Continual Novelty Detection

How Do Human Users Teach a Continual Learning Robot in Repeated Interactions?

Open-World Continual Learning: Unifying Novelty Detection and Continual Learning

Continual Learning for Autonomous Robots: A Prototype-based Approach

Towards Lifelong Object Recognition: A Dataset and Benchmark

CBCL-PR: A Cognitively Inspired Model for Class-Incremental Learning in Robotics

A Comprehensive Survey of Continual Learning: Theory, Method and Application

Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges

Learning by Asking Questions for Knowledge-Based Novel Object Recognition

3D_DEN: Open-ended 3D Object Recognition using Dynamically Expandable Networks

Evaluating Continual Learning on a Home Robot

Here's What I've Learned: Asking Questions that Reveal Reward Learning