Abstract:Visual object recognition is a key challenge to the deployment of robots in domains characterized by partial observability and unforeseen changes. Sophisticated algorithms developed for modeling and recognizing objects using different visual cues [Mikolajczyk:IJCV04,Porway:PAMI11] are computationally expensive, sensitive to changes in object configurations and environmental factors, and require many training samples and accurate domain knowledge to learn object models, making it difficult for robots to reliably and efficiently model and recognize objects. These challenges are partially offset by the fact that many objects possess unique characteristics (e.g., color and shape) and motion patterns, although these characteristics and patterns are not known in advance and may change over time. Furthermore, only a subset of domain objects are relevant to any given task and a variety of cues can be extracted from images to represent objects. This paper presents an algorithm that enables robots to identify a set of interesting objects, using appearance-based and contextual cues extracted from a small number of images to efficiently learn models of these objects. Robots learn the domain map and consider objects that move to be interesting, using motion cues to identify the corresponding image regions. Object models learned automatically from these regions consist of spatial arrangement of gradient features, graph-based models of neighborhoods of gradient features, parts-based models of image segments, color distributions, and mixture models of local context. The learned models are used for object recognition in novel scenes based on energy minimization and a generative model for information fusion. All algorithms are evaluated on wheeled robots in indoor and outdoor domains.

Model-based recognition in robot vision for monitoring built environments

Object Fingerprinting-Based Environment Model for Service Robots: Task-Oriented Modeling Approach

Learning visual object models on a robot using context and appearance cues

3D Recognition Based on Sensor Modalities for Robotic Systems: A Survey

Identification of Unmodeled Objects from Symbolic Descriptions

Model based 3-D object recognition

Robotics multi-modal recognition system via computer-based vision

Kinematically-Informed Interactive Perception: Robot-Generated 3D Models for Classification

A Robot Object Recognition Method Based on Scene Text Reading in Home Environments

PackerRobo: Model-based Robot Vision Self Supervised Learning in CART

Augmented Environment Representations with Complete Object Models

On Object Perception in Enhanced Reality Environment for Robot Telecontrol

A Review of Model Based Online Identification Methods for Robotic Systems

Reasearch on object recognition of intelligent robot base on binocular vision

Investigating the Importance of Shape Features, Color Constancy, Color Spaces and Similarity Measures in Open-Ended 3D Object Recognition

Partial Observer Decision Process Model for Crane-Robot Action

BIM-assisted object recognition for the on-site autonomous robotic assembly of discrete structures

Robot-Assisted Object Detection for Construction Automation: Data and Information-Driven Approach

Recognizing Objects In-the-wild: Where Do We Stand?

Building a model of recognizing operators based on the definition of basic reference objects

An Autonomous Visual Perception Model For Robots Using Object-Based Attention Mechanism