Abstract:Simultaneous Localization and Mapping (SLAM) consists of the estimation of the state of the robot, and the reconstruction of the surrounding environment simultaneously. Over the last few decades, numerous state-of-the-art SLAM algorithms are proposed and frequently utilized in the robotics community. However, a SLAM algorithm might be fragile or even fail due to imperfect sensor data, uncontrived environments and hardware failures. Furthermore, many approaches sacrifice loop closure and reduce to odometry, which might suffer from accumulated drift. In addition, most of the SLAM systems only provide metric representations for mapping, which is difficult for high-level robot tasks. In this thesis, we first explore the integration of the monocular camera, a Light Detection and Ranging (Lidar) sensor, and an Inertial Measurement Unit (IMU) to achieve the accurate and robust state estimation. We then propose one loop closure module combining camera and Lidar’s measurements to correct motion estimation drift. Finally, we propose one 3D semantic occupancy mapping framework integrating monocular vision, Lidar’s measurements and our state estimation system. We first test our state estimation system on the publicly available datasets as well as challenging custom collected datasets. Then, a series of experiments are conducted to demonstrate the effectiveness of the loop closure module. Finally, the KITTI odometry dataset is used to demonstrate our 3D semantic occupancy mapping framework. The experimental results indicate that our proposed state estimation system works well in various challenging environments and an accurate large-scale semantic map can be constructed.

Robust monocular SLAM using one 3D point

Stereo Vision Based SLAM in Outdoor Environments

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Environment Map Building and Localization for Robot Navigation Based on Image Sequences

Robust Monocular SLAM in Dynamic Environments

Robust Keyframe-Based Monocular SLAM for Augmented Reality

Monocular Visual SLAM of Unmanned Helicopter Based on 2-Point RANSAC

Mobile Robot Simultaneous Localization and Mapping Based on A Monocular Camera

Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines

MonoSLAM: Real-Time Single Camera SLAM

Accurate and Robust Monocular SLAM with Omnidirectional Cameras

Robust Perception-based Visual Simultaneous Localization and Tracking in Dynamic Environments

Monocular Vision SLAM for Large Scale Outdoor Environment

Robust And Fast Mapping Based On Direct Methods

A Robust Deep Learning Enhanced Monocular SLAM System for Dynamic Environments

Monocular Object and Plane SLAM in Structured Environments

A Robust Semi-Direct 3D SLAM for Mobile Robot Based on Dense Optical Flow in Dynamic Scenes

Realization of SLAM based on monocular vision and lines tracking

Multi-Sensor Fusion for Robust Simultaneous Localization and Mapping

Monocular Visual-Inertial Navigation for Dynamic Environment