Abstract:In real-world applications, robotic systems collect vast amounts of new data from ever-changing environments over time. They need to continually interact and learn new knowledge from the external world to adapt to the environment. Particularly, lifelong object recognition in an online and interactive manner is a crucial and fundamental capability for robotic systems. To meet this realistic demand, in this article, we propose an online active continual learning (OACL) framework for robotic lifelong object recognition, in the scenario of both classes and domains changing with dynamic environments. First, to reduce the labeling cost as much as possible while maximizing the performance, a new online active learning (OAL) strategy is designed by taking both the uncertainty and diversity of samples into account to protect the information volume and distribution of data. In addition, to prevent catastrophic forgetting and reduce memory costs, a novel online continual learning (OCL) algorithm is proposed based on the deep feature semantic augmentation and a new loss-based deep model and replay buffer update, which can mitigate the class imbalance between the old and new classes and alleviate confusion between two similar classes. Moreover, the mistake bound of the proposed method is analyzed in theory. OACL allows robots to select the most representative new samples to query labels and continually learn new objects and new variants of previously learned objects from a nonindependent and identically distributed (i.i.d.) data stream without catastrophic forgetting. Extensive experiments conducted on real lifelong robotic vision datasets demonstrate that our algorithm, even trained with fewer labeled samples and replay exemplars, can achieve state-of-the-art performance on OCL tasks.

CUAL: Continual Uncertainty-aware Active Learner

Uncertainty-aware Complementary Label Queries for Active Learning

Uncertainty Quantification in Continual Open-World Learning

Uncertainty-driven active developmental learning

Active Learning with Controllable Augmentation Induced Acquisition

Bidirectional Uncertainty-Based Active Learning for Open Set Annotation

Online Continual Learning For Interactive Instruction Following Agents

CONCLAD: COntinuous Novel CLAss Detector

Uncertainty-based modulation for lifelong learning

Unified Uncertainty Calibration

Towards Uncertainty-Aware Language Agent

Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning

Uncertainty-Aware Learning against Label Noise on Imbalanced Datasets

Uncertainty Aware Learning for Language Model Alignment

Uncertainty-aware Active Learning for Optimal Bayesian Classifier

Online Active Continual Learning for Robotic Lifelong Object Recognition

Uncertainty-Aware Distillation for Semi-Supervised Few-Shot Class-Incremental Learning

Dual Adversarial Network for Deep Active Learning

Uncertainty-weighted prototype active learning in domain adaptive semantic segmentation

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation

Uncertainty Feature Learning with Personalized Class Description for Visual Domain Adaptation