Abstract:Indoor location-based services constitute an important part of our daily lives, providing position and direction information about people or objects in indoor spaces. These systems can be useful in security and monitoring applications that target specific areas such as rooms. Vision-based scene recognition is the task of accurately identifying a room category from a given image. Despite years of research in this field, scene recognition remains an open problem due to the different and complex places in the real world. Indoor environments are relatively complicated because of layout variability, object and decoration complexity, and multiscale and viewpoint changes. In this paper, we propose a room-level indoor localization system based on deep learning and built-in smartphone sensors combining visual information with smartphone magnetic heading. The user can be room-level localized while simply capturing an image with a smartphone. The presented indoor scene recognition system is based on direction-driven convolutional neural networks (CNNs) and therefore contains multiple CNNs, each tailored for a particular range of indoor orientations. We present particular weighted fusion strategies that improve system performance by properly combining the outputs from different CNN models. To meet users' needs and overcome smartphone limitations, we propose a hybrid computing strategy based on mobile computation offloading compatible with the proposed system architecture. The implementation of the scene recognition system is split between the user's smartphone and a server, which aids in meeting the computational requirements of CNNs. Several experimental analysis were conducted, including to assess performance and provide a stability analysis. The results obtained on a real dataset show the relevance of the proposed approach for localization, as well as the interest in model partitioning in hybrid mobile computation offloading. Our extensive evaluation demonstrates an increase in accuracy compared to traditional CNN scene recognition, indicating the effectiveness and robustness of our approach.

Scene perception based visual navigation of mobile robot in indoor environment

Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

A Computer Vision for Navigation of Mobile Robots

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

A CNN-Based System for Mobile Robot Navigation in Indoor Environments via Visual Localization with a Small Dataset

Robot visual navigation estimation and target localization based on neural network

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Vision-based mobile robot navigation through deep convolutional neural networks and end-to-end learning

Autonomous Navigation in Dynamic Environments: Deep Learning-Based Approach

Direction-driven Navigation Using Cognitive Map for Mobile Robots

Vision-based Mobile Robot's Environment Outdoor Perception

DeepNav: A scalable and plug-and-play indoor navigation system based on visual CNN

A Novel Artificial Organic Control System for Mobile Robot Navigation in Assisted Living Using Vision- and Neural-Based Strategies

Monocular Vision Navigation and Control of Mobile Robot

Robot Navigation with Map-Based Deep Reinforcement Learning

A Hybrid Approach to Real-Time Robotic Visual Navigation: Integrating Detection and Scene Segmentation

Localization and Navigation for Indoor Mobile Robot Based on ROS

Safe and Robust Mobile Robot Navigation in Uneven Indoor Environments

IRDC-Net: Lightweight Semantic Segmentation Network Based on Monocular Camera for Mobile Robot Navigation

Robot visual perception and autonomous obstacle avoidance based on deep learning

Indoor Scene Recognition Mechanism Based on Direction-Driven Convolutional Neural Networks