Abstract:Service robots are integrating more and more into our daily lives to help us with various tasks. In such environments, robots frequently face new objects while working in the environment and need to learn them in an open-ended fashion. Furthermore, such robots must be able to recognize a wide range of object categories. In this paper, we present a lifelong ensemble learning approach based on multiple representations to address the few-shot object recognition problem. In particular, we form ensemble methods based on deep representations and handcrafted 3D shape descriptors. To facilitate lifelong learning, each approach is equipped with a memory unit for storing and retrieving object information instantly. The proposed model is suitable for open-ended learning scenarios where the number of 3D object categories is not fixed and can grow over time. We have performed extensive sets of experiments to assess the performance of the proposed approach in offline, and open-ended scenarios. For the evaluation purpose, in addition to real object datasets, we generate a large synthetic household objects dataset consisting of 27000 views of 90 objects. Experimental results demonstrate the effectiveness of the proposed method on online few-shot 3D object recognition tasks, as well as its superior performance over the state-of-the-art open-ended learning approaches. Furthermore, our results show that while ensemble learning is modestly beneficial in offline settings, it is significantly beneficial in lifelong few-shot learning situations. Additionally, we demonstrated the effectiveness of our approach in both simulated and real-robot settings, where the robot rapidly learned new categories from limited examples.

Bayesian Embeddings for Few-Shot Open World Recognition

Unlocking Transfer Learning for Open-World Few-Shot Recognition

Towards Few-Shot Learning in the Open World: A Review and Beyond

Few-Shot Open-Set Recognition using Meta-Learning

Few-shot Weakly-Supervised Object Detection via Directional Statistics

Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning

Few-Shot Continual Learning via Flat-to-Wide Approaches

Learning Relative Feature Displacement for Few-Shot Open-Set Recognition

Only Image Cosine Embedding for Few-Shot Learning

Few-Shot Learning With Embedded Class Models and Shot-Free Meta Training

Towards Open World Recognition

Wandering Within a World: Online Contextualized Few-Shot Learning

EOL: Transductive Few-Shot Open-Set Recognition by Enhancing Outlier Logits

Domain Adaptive Few-Shot Open-Set Learning

Hyperbolic Learning with Synthetic Captions for Open-World Detection

From Open Vocabulary to Open World: Teaching Vision Language Models to Detect Novel Objects

Open-World Visual Recognition Using Knowledge Graphs

Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognition

Lifelong Ensemble Learning based on Multiple Representations for Few-Shot Object Recognition

Self-Supervised Features Improve Open-World Learning