Abstract:Simultaneous Localization and Mapping (SLAM) consists of the estimation of the state of the robot, and the reconstruction of the surrounding environment simultaneously. Over the last few decades, numerous state-of-the-art SLAM algorithms are proposed and frequently utilized in the robotics community. However, a SLAM algorithm might be fragile or even fail due to imperfect sensor data, uncontrived environments and hardware failures. Furthermore, many approaches sacrifice loop closure and reduce to odometry, which might suffer from accumulated drift. In addition, most of the SLAM systems only provide metric representations for mapping, which is difficult for high-level robot tasks. In this thesis, we first explore the integration of the monocular camera, a Light Detection and Ranging (Lidar) sensor, and an Inertial Measurement Unit (IMU) to achieve the accurate and robust state estimation. We then propose one loop closure module combining camera and Lidar’s measurements to correct motion estimation drift. Finally, we propose one 3D semantic occupancy mapping framework integrating monocular vision, Lidar’s measurements and our state estimation system. We first test our state estimation system on the publicly available datasets as well as challenging custom collected datasets. Then, a series of experiments are conducted to demonstrate the effectiveness of the loop closure module. Finally, the KITTI odometry dataset is used to demonstrate our 3D semantic occupancy mapping framework. The experimental results indicate that our proposed state estimation system works well in various challenging environments and an accurate large-scale semantic map can be constructed.

Multi-Scan Multi-Sensor Multi-Object State Estimation

Multi-Sensor Multi-Scan Radar Sensing of Multiple Extended Targets

Estimation with Multisensor/Multiscan Detection Fusion

Multi-Target Detection and Estimation with the Use of Massive Independent, Identical Sensors

Multi-sensor Multi-Object Joint Detection and Tracking from Image Observations Using Labeled Multi-Bernoulli Densities

Multi-Sensor Control for Multi-Object Bayes Filters

Enhanced multi-model multi-scan data association and tracking algorithm via convex variational inference

An Overview of Multi-Object Estimation via Labeled Random Finite Set

Multi-Sensor Multi-Frame Detection Based on Posterior Probability Density Fusion.

Multiple Passive Sensor Multi-Target Tracking Based on Multidimensional Assignment

Multi-objective Optimization for Sensor Placement: an Integrated Combinatorial Approach with Reduced Order Model and Gaussian Process

Multisensor Multiobject Tracking with Improved Sampling Efficiency

Efficient Estimation of Sensor Biases for the 3-Dimensional Asynchronous Multi-Sensor System

Fast, Robust, Accurate, Multi-Body Motion Aware SLAM

Scan-Specific Unsupervised Highly Accelerated Non-Cartesian CEST Imaging Using Implicit Neural Representation and Explicit Sparse Prior

Multi-Objective Optimization Based Multi-Bernoulli Sensor Selection for Multi-Target Tracking

Evolutionary Computational Intelligence-Based Multi-Objective Sensor Management for Multi-Target Tracking

Multi-Sensor Fusion for Robust Simultaneous Localization and Mapping

Multi-View Keypoints for Reliable 6D Object Pose Estimation