Abstract:After decades of research, there is still no solution for indoor localization like the GNSS (Global Navigation Satellite System) solution for outdoor environments. The major reasons for this phenomenon are the complex spatial topology and RF transmission environment. To deal with these problems, an indoor scene constrained method for localization is proposed in this paper, which is inspired by the visual cognition ability of the human brain and the progress in the computer vision field regarding high-level image understanding. Furthermore, a multi-sensor fusion method is implemented on a commercial smartphone including cameras, WiFi and inertial sensors. Compared to former research, the camera on a smartphone is used to "see" which scene the user is in. With this information, a particle filter algorithm constrained by scene information is adopted to determine the final location. For indoor scene recognition, we take advantage of deep learning that has been proven to be highly effective in the computer vision community. For particle filter, both WiFi and magnetic field signals are used to update the weights of particles. Similar to other fingerprinting localization methods, there are two stages in the proposed system, offline training and online localization. In the offline stage, an indoor scene model is trained by Caffe (one of the most popular open source frameworks for deep learning) and a fingerprint database is constructed by user trajectories in different scenes. To reduce the volume requirement of training data for deep learning, a fine-tuned method is adopted for model training. In the online stage, a camera in a smartphone is used to recognize the initial scene. Then a particle filter algorithm is used to fuse the sensor data and determine the final location. To prove the effectiveness of the proposed method, an Android client and a web server are implemented. The Android client is used to collect data and locate a user. The web server is developed for indoor scene model training and communication with an Android client. To evaluate the performance, comparison experiments are conducted and the results demonstrate that a positioning accuracy of 1.32 m at 95% is achievable with the proposed solution. Both positioning accuracy and robustness are enhanced compared to approaches without scene constraint including commercial products such as IndoorAtlas.

Communication Scene Recognition Method Based on Multi Phone Sensors and Deep Learning

WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge Intelligence

DeepCamera

Scene Recognition for Indoor Localization Using a Multi-Sensor Fusion Approach

A New Scene Sensing Model Based on Multi-Source Data from Smartphones

Indoor Scene Recognition Mechanism Based on Direction-Driven Convolutional Neural Networks

Outdoor scene understanding of mobile robot via multi-sensor information fusion

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Video Surveillance on Mobile Edge Networks—A Reinforcement-Learning-Based Approach

A Deep-Learning Based GNSS Scene Recognition Method for Detailed Urban Static Positioning Task via Low-Cost Receivers

Motion Recognition By Using A Stacked Autoencoder-Based Deep Learning Algorithm With Smart Phones

Deep-learning methods for integrated sensing and communication in vehicular networks

Position-Aware Indoor Human Activity Recognition Using Multisensors Embedded in Smartphones

Deep-Learning-Based Real-Time Passive Non-Line-of-Sight Imaging for Room-Scale Scenes

A Hybrid Deep Learning System for Real-World Mobile User Authentication Using Motion Sensors

Face Detection and Recognition Based on Deep Learning in the Monitoring Environment.

A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition

DFECF-DET: All-Weather Detector Based on Differential Feature Enhancement and Cross-Modal Fusion With Visible and Infrared Sensors

A Face Sequence Recognition Method Based on Deep Convolutional Neural Network

Scene recognition under special traffic conditions based on deep multi‐task learning

Mobile Recording Device Recognition Based Cross-Scale and Multi-Level Representation Learning