Abstract:Mobile robotics has achieved notable progress, however, to increase the complexity of the tasks that mobile robots can perform in natural environments, we need to provide them with a greater semantic understanding of their surrounding. In particular, identifying indoor scenes, such as an Office or a Kitchen, is a highly valuable perceptual ability for an indoor mobile robot, and in this paper we propose a new technique to achieve this goal. As a distinguishing feature, we use common objects, such as Doors or furniture, as a key intermediate representation to recognize indoor scenes. We frame our method as a generative probabilistic hierarchical model, where we use object category classifiers to associate low-level visual features to objects, and contextual relations to associate objects to scenes. The inherent semantic interpretation of common objects allows us to use rich sources of online data to populate the probabilistic terms of our model. In contrast to alternative computer vision based methods, we boost performance by exploiting the embedded and dynamic nature of a mobile robot. In particular, we increase detection accuracy and efficiency by using a 3D range sensor that allows us to implement a focus of attention mechanism based on geometric and structural information. Furthermore, we use concepts from information theory to propose an adaptive scheme that limits computational load by selectively guiding the search for informative objects. The operation of this scheme is facilitated by the dynamic nature of a mobile robot that is constantly changing its field of view. We test our approach using real data captured by a mobile robot navigating in Office and home environments. Our results indicate that the proposed approach outperforms several state-of-the-art techniques for scene recognition.

Semantic-Relation-First Active Learning for Scene Understanding in Indoor Environments

Learning Object Spatial Relationship from Demonstration

Active Scene Understanding via Online Semantic Reconstruction

Object-to-Scene: Learning to Transfer Object Knowledge to Indoor Scene Recognition

Automatic Semantic Modeling of Indoor Scenes from Low-Quality RGB-D Data Using Contextual Information

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Active Learning the Model for Indoor Scene Classification

Towards Robotic Semantic Segmentation of Supporting Surfaces

Semi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planning

Indoor Scene Recognition via Object Detection and TF-IDF

Indoor scene recognition through object detection

Indoor Semantic Scene Understanding using Multi-modality Fusion

Indoor scene recognition by a mobile robot through adaptive object detection

Scene Classification in Indoor Environments for Robots using Context Based Word Embeddings

An Approach for Construct Semantic Map with Scene Classification and Object Semantic Segmentation

Indoor Scene Recognition: An Attention-Based Approach Using Feature Selection-Based Transfer Learning and Deep Liquid State Machine

SRRM: Semantic Region Relation Model for Indoor Scene Recognition

Semantic-guided modeling of spatial relation and object co-occurrence for indoor scene recognition

Indoor Scene Recognition from RGB-D Images by Learning Scene Bases

Indoor Environment Semantic Topological Mapping Based on Deep Learning.

Indoor Scene Classification Algorithm Based on an Object Vector for Robot Applications.