Abstract:Image based reconstruction of urban environments is a challenging problem that deals with optimization of large number of variables, and has several sources of errors like the presence of dynamic objects. Since most large scale approaches make the assumption of observing static scenes, dynamic objects are relegated to the noise modeling section of such systems. This is an approach of convenience since the RANSAC based framework used to compute most multiview geometric quantities for static scenes naturally confine dynamic objects to the class of outlier measurements. However, reconstructing dynamic objects along with the static environment helps us get a complete picture of an urban environment. Such understanding can then be used for important robotic tasks like path planning for autonomous navigation, obstacle tracking and avoidance, and other areas. In this paper, we propose a system for robust SLAM that works in both static and dynamic environments. To overcome the challenge of dynamic objects in the scene, we propose a new model to incorporate semantic constraints into the reconstruction algorithm. While some of these constraints are based on multi-layered dense CRFs trained over appearance as well as motion cues, other proposed constraints can be expressed as additional terms in the bundle adjustment optimization process that does iterative refinement of 3D structure and camera / object motion trajectories. We show results on the challenging KITTI urban dataset for accuracy of motion segmentation and reconstruction of the trajectory and shape of moving objects relative to ground truth. We are able to show average relative error reduction by a significant amount for moving object trajectory reconstruction relative to state-of-the-art methods like VISO 2, as well as standard bundle adjustment algorithms.

Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Local Optimized and Scalable Frame-to-model SLAM

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Tightly-Coupled LiDAR-Visual-Inertial SLAM and Large-Scale Volumetric Occupancy Mapping

Dense RGB-D-Inertial SLAM with Map Deformations

Model-based Dynamic Pose Graph SLAM in Unstructured Dynamic Environments

Uncertainty-Aware Visual-Inertial SLAM with Volumetric Occupancy Mapping

A Hybrid Sparse-Dense Monocular SLAM System for Autonomous Driving

Neural Implicit Dense Semantic SLAM

CodeMapping: Real-Time Dense Mapping for Sparse SLAM using Compact Scene Representations

DeepFactors: Real-Time Probabilistic Dense Monocular SLAM

A Variational Observation Model of 3D Object for Probabilistic Semantic SLAM

Tracking and Planning with Spatial World Models

StereoNeuroBayesSLAM: A Neurobiologically Inspired Stereo Visual SLAM System Based on Direct Sparse Method

3D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation

VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalization

HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM

Dynamic Body VSLAM with Semantic Constraints

SimpleMapping: Real-Time Visual-Inertial Dense Mapping with Deep Multi-View Stereo