Abstract:Monocular approaches to simultaneous localization and mapping (SLAM) have recently addressed with success the challenging problem of the fast computation of dense reconstructions from a single, moving camera. Thus, if these approaches initially relied on the detection of a reduced set of interest points to estimate the camera position and the map, they are currently able to reconstruct dense maps from a handheld camera while the camera coordinates are simultaneously computed. However, these maps of 3-dimensional points usually remain meaningless, that is, with no memorable items and without providing a way of encoding spatial relationships between objects and paths. In humans and mobile robotics, landmarks play a key role in the internalization of a spatial representation of an environment. They are memorable cues that can serve to define a region of the space or the location of other objects. In a topological representation of the space, landmarks can be identified and located according to its structural, perceptive or semantic significance and distinctiveness. But on the other hand, landmarks may be difficult to be located in a metric representation of the space. Restricted to the domain of visual landmarks, this work describes an approach where the map resulting from a point-based, monocular SLAM is annotated with the semantic information provided by a set of distinguished landmarks. Both features are obtained from the image. Hence, they can be linked by associating to each landmark all those point-based features that are superimposed to the landmark in a given image (key-frame). Visual landmarks will be obtained by means of an object-based, bottom-up attention mechanism, which will extract from the image a set of proto-objects. These proto-objects could not be always associated with natural objects, but they will typically constitute significant parts of these scene objects and can be appropriately annotated with semantic information. Moreover, they will be affine covariant regions, that is, they will be invariant to affine transformation, being detected under different viewing conditions (view-point angle, rotation, scale, etc.). Monocular SLAM will be solved using the accurate parallel tracking and mapping (PTAM) framework by Klein and Murray in Proceedings of IEEE/ACM international symposium on mixed and augmented reality, 2007.

Feasibility of Tracking Human Kinematics with Simultaneous Localization and Mapping (SLAM)

Augmenting Inertial Motion Capture with SLAM Using EKF and SRUKF Data Fusion Algorithms

Local Optimized and Scalable Frame-to-model SLAM

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking

MonoSLAM: Real-Time Single Camera SLAM

Unified framework for recognition, localization and mapping using wearable cameras

Adaptive Monocular Visual-Inertial SLAM for Real-Time Augmented Reality Applications in Mobile Devices

Keyframe-based visual-inertial online SLAM with relocalization

EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors

VR-SLAM: A Visual-Range Simultaneous Localization and Mapping System using Monocular Camera and Ultra-wideband Sensors

Hybrid Feature Based SLAM Prototype

Camera, LiDAR and Multi-modal SLAM Systems for Autonomous Ground Vehicles: a Survey

Reconfigurable System-on-Chip Architectures for Robust Visual SLAM on Humanoid Robots

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging

Fusion LiDAR-Inertial-Encoder data for High-Accuracy SLAM

An Enhanced Multi-Sensor Simultaneous Localization and Mapping (SLAM) Framework with Coarse-to-Fine Loop Closure Detection Based on a Tightly Coupled Error State Iterative Kalman Filter

HVL-SLAM: Hybrid Vision and LiDAR Fusion for SLAM

On combining visual SLAM and visual odometry

Angular Tracking Consistency Guided Fast Feature Association for Visual-Inertial SLAM

Sensor Fusion SLAM: An Efficient and Robust SLAM system for Dynamic Environments