Abstract:The recent breakthroughs in computer vision have benefited from the availability of large representative datasets (e.g. ImageNet and COCO) for training. Yet, robotic vision poses unique challenges for applying visual algorithms developed from these standard computer vision datasets due to their implicit assumption over non-varying distributions for a fixed set of tasks. Fully retraining models each time a new task becomes available is infeasible due to computational, storage and sometimes privacy issues, while naïve incremental strategies have been shown to suffer from catastrophic forgetting. It is crucial for the robots to operate continuously under open-set and detrimental conditions with adaptive visual perceptual systems, where lifelong learning is a fundamental capability. However, very few datasets and benchmarks are available to evaluate and compare emerging techniques. To fill this gap, we provide a new lifelong robotic vision dataset ("OpenLORIS-Object") collected via RGB-D cameras. The dataset embeds the challenges faced by a robot in the real-life application and provides new benchmarks for validating lifelong object recognition algorithms. Moreover, we have provided a testbed of $9$ state-of-the-art lifelong learning algorithms. Each of them involves $48$ tasks with $4$ evaluation metrics over the OpenLORIS-Object dataset. The results demonstrate that the object recognition task in the ever-changing difficulty environments is far from being solved and the bottlenecks are at the forward/backward transfer designs. Our dataset and benchmark are publicly available at at \href{<a class="link-external link-https" href="https://lifelong-robotic-vision.github.io/dataset/object" rel="external noopener nofollow">this https URL</a>}{\underline{<a class="link-external link-https" href="https://lifelong-robotic-vision.github.io/dataset/object" rel="external noopener nofollow">this https URL</a>}}.

Lifelong ensemble learning based on multiple representations for few-shot object recognition

Lifelong Ensemble Learning based on Multiple Representations for Few-Shot Object Recognition

Look Further to Recognize Better: Learning Shared Topics and Category-Specific Dictionaries for Open-Ended 3D Object Recognition

Robust Object Tracking with a Hierarchical Ensemble Framework

3D_DEN: Open-ended 3D Object Recognition using Dynamically Expandable Networks

Open-Ended Fine-Grained 3D Object Categorization by Combining Shape and Texture Features in Multiple Colorspaces

Online Active Continual Learning for Robotic Lifelong Object Recognition

Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization

Towards Lifelong Object Recognition: A Dataset and Benchmark

OpenLORIS-Object: A Dataset and Benchmark towards Lifelong Object Recognition

Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization Networks

OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning

Learning Few-Shot Object Placement with Intra-Category Transfer

Online Object Representations with Contrastive Learning

IROS 2019 Lifelong Robotic Vision: Object Recognition Challenge [Competitions]

Lifelong Learning for Scene Recognition in Remote Sensing Images

Customized Object Recognition And Segmentation By One Shot Learning With Human Robot Interaction

Online Visual Robot Tracking and Identification using Deep LSTM Networks

Online Multi-modal Imitation Learning Via Lifelong Intention Encoding.

Incremental Few-Shot Object Detection for Robotics

FewSOL: A Dataset for Few-Shot Object Learning in Robotic Environments