Abstract:Tracking and modeling unknown rigid objects in the environment play a crucial role in autonomous unmanned systems and virtual-real interactive applications. However, many existing Simultaneous Localization, Mapping and Moving Object Tracking (SLAMMOT) methods focus solely on estimating specific object poses and lack estimation of object scales and are unable to effectively track unknown objects. In this paper, we propose a novel SLAM backend that unifies ego-motion tracking, rigid object motion tracking, and modeling within a joint optimization framework. In the perception part, we designed a pixel-level asynchronous object tracker (AOT) based on the Segment Anything Model (SAM) and DeAOT, enabling the tracker to effectively track target unknown objects guided by various predefined tasks and prompts. In the modeling part, we present a novel object-centric quadric parameterization to unify both static and dynamic object initialization and optimization. Subsequently, in the part of object state estimation, we propose a tightly coupled optimization model for object pose and scale estimation, incorporating hybrids constraints into a novel dual sliding window optimization framework for joint estimation. To our knowledge, we are the first to tightly couple object pose tracking with light-weight modeling of dynamic and static objects using quadric. We conduct qualitative and quantitative experiments on simulation datasets and real-world datasets, demonstrating the state-of-the-art robustness and accuracy in motion estimation and modeling. Our system showcases the potential application of object perception in complex dynamic scenes.

Accurate and Robust Object-oriented SLAM with 3D Quadric Landmark Construction in Outdoor Environment

Accurate and Robust Object SLAM with 3D Quadric Landmark Reconstruction in Outdoors

Stereo Vision Based SLAM in Outdoor Environments

Object SLAM with Robust Quadric Initialization and Mapping for Dynamic Outdoors

A robust stereo feature-aided semi-direct SLAM system

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Object-Aware SLAM Based on Efficient Quadric Initialization and Joint Data Association.

Object-oriented SLAM using Quadrics and Symmetry Properties for Indoor Environments

DynaQuadric: Dynamic Quadric SLAM for Quadric Initialization, Mapping, and Tracking

Robust Monocular SLAM in Dynamic Environments

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

Object SLAM with Dual Quadric Parameterization

Environmentally Robust Laser-Inertial SLAM System Under Multiple Constraints

UniQuadric: A SLAM Backend for Unknown Rigid Object 3D Tracking and Light-Weight Modeling.

QISO-SLAM: Object-Oriented SLAM Using Dual Quadrics as Landmarks Based on Instance Segmentation

SQ-SLAM: Monocular Semantic SLAM Based on Superquadric Object Representation

RGB-D Object SLAM Using Quadrics for Indoor Environments

Superquadric Object Representation for Optimization-based Semantic SLAM

A Stereo Vision SLAM with Moving Vehicles Tracking in Outdoor Environment

A Robust Visual SLAM System for Low-Texture and Semi-Static Environments

An Efficient and Accurate 3D SLAM Method for Dynamic Environment