Abstract:The recent breakthroughs in computer vision have benefited from the availability of large representative datasets (e.g. ImageNet and COCO) for training. Yet, robotic vision poses unique challenges for applying visual algorithms developed from these standard computer vision datasets due to their implicit assumption over non-varying distributions for a fixed set of tasks. Fully retraining models each time a new task becomes available is infeasible due to computational, storage and sometimes privacy issues, while naïve incremental strategies have been shown to suffer from catastrophic forgetting. It is crucial for the robots to operate continuously under open-set and detrimental conditions with adaptive visual perceptual systems, where lifelong learning is a fundamental capability. However, very few datasets and benchmarks are available to evaluate and compare emerging techniques. To fill this gap, we provide a new lifelong robotic vision dataset ("OpenLORIS-Object") collected via RGB-D cameras. The dataset embeds the challenges faced by a robot in the real-life application and provides new benchmarks for validating lifelong object recognition algorithms. Moreover, we have provided a testbed of $9$ state-of-the-art lifelong learning algorithms. Each of them involves $48$ tasks with $4$ evaluation metrics over the OpenLORIS-Object dataset. The results demonstrate that the object recognition task in the ever-changing difficulty environments is far from being solved and the bottlenecks are at the forward/backward transfer designs. Our dataset and benchmark are publicly available at at \href{<a class="link-external link-https" href="https://lifelong-robotic-vision.github.io/dataset/object" rel="external noopener nofollow">this https URL</a>}{\underline{<a class="link-external link-https" href="https://lifelong-robotic-vision.github.io/dataset/object" rel="external noopener nofollow">this https URL</a>}}.

CURE-OR: Challenging Unreal and Real Environments for Object Recognition

Recognizing Objects In-the-wild: Where Do We Stand?

CURE: A dataset for Clinical Understanding & Retrieval Evaluation

OpenLORIS-Object: A Dataset and Benchmark towards Lifelong Object Recognition

OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning

Towards Lifelong Object Recognition: A Dataset and Benchmark

CLOVER: Context-aware Long-term Object Viewpoint- and Environment- Invariant Representation Learning

Robust object recognition via context-driven reliability assessment

On Recognizing Occluded Faces in the Wild

Cubify Anything: Scaling Indoor 3D Object Detection

Multi-Modal Dataset Acquisition for Photometrically Challenging Object

ClearPose: Large-scale Transparent Object Dataset and Benchmark

OOWL500: Overcoming Dataset Collection Bias in the Wild

Towards Robust Perception for Assistive Robotics: An RGB-Event-LiDAR Dataset and Multi-Modal Detection Pipeline

Road and Railway Smart Mobility: A High-Definition Ground Truth Hybrid Dataset

Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Dataset

QueensCAMP: an RGB-D dataset for robust Visual SLAM

Care3D: An Active 3D Object Detection Dataset of Real Robotic-Care Environments

TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline

ImageNet Large Scale Visual Recognition Challenge

Benchmarking performance of object detection under image distortions in an uncontrolled environment