Abstract:Simultaneous localization and mapping (SLAM) utilizing visual sensors represent an extensively investigated research area, holding significant potential for advancements in robotics and autonomous vehicular systems. Recently, dense SLAM systems underpinned by learning-based methodologies have showcased superior accuracy and robustness compared to conventional techniques. Nevertheless, contemporary learning-based SLAM systems exhibit notable discrepancies in pose estimation, particularly within dynamic environments. In addition, the constrained receptive field of convolutional features in these methods impedes their efficacy when confronted with homogeneous, texture-less images, rendering them vulnerable to noise perturbations. We develop a novel deep visual dynamic slam (DVDS) system that exploits solely static pixels within images to retrieve the camera poses. Specifically, we formulate a dynamic object exclusion mechanism that excises dynamic constituents within the scene before the optical flow computation, thus optimizing the precision of the estimation. In addition, we unveil an efficient dispersive transformer (DisFormer) that facilitates per-pixel features in assimilating long-range information from surrounding features, culminating in constructing more precise 4D correlation volumes. Building on the DisFormer, we suggest a Disformer-based gated recurrent unit (GRU) to generate a refined flow field coupled with a confidence map, which is subsequently employed by the dense bundle adjustment layer to iteratively rectify the residuals of inverse depths and associated camera poses. The global receptive field provided by the DisFormer promotes information integration from a wider contextual window, thus improving the robustness of our SLAM system. Comprehensive experiments underscore that our proposed DVDS system manifests superior efficacy compared with state-of-the-art works across both static and dynamic scenes.

Queue-based Spatiotemporal Filter and Clustering for Dynamic Vision Sensor

An O(m+n)-Space Spatiotemporal Denoising Filter with Cache-Like Memories for Dynamic Vision Sensors

SeqXFilter: A Memory-efficient Denoising Filter for Dynamic Vision Sensors

A Noise Filter for Dynamic Vision Sensors using Self-adjusting Threshold

Small Low-Contrast Target Detection: Data-Driven Spatiotemporal Feature Fusion and Implementation

Adaptive Slicing Method of the Spatiotemporal Event Stream Obtained from a Dynamic Vision Sensor

An Efficient Space Spatiotemporal Noise Filter for Dynamic Vision Sensor

An Efficient Hash-based Data Structure for Dynamic Vision Sensors and its Application to Low-energy Low-memory Noise Filtering

Denoising Method for Dynamic Vision Sensor Based on Two-Dimensional Event Density

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Vision-Based Moving Objects Detection with Background Modeling

ProgressiveMotionSeg: Mutually Reinforced Framework for Event-Based Motion Segmentation

Video abstraction based on the visual attention model and online clustering

During neonatal mechanical ventilatory support, the delivered nitric oxide concentration is affected by the ventilatory setting

Real-time clustering and multi-target tracking using event-based sensors

An Efficient Markov Random Field Based Denoising Approach for Dynamic Vision Sensor

An Event Coding Method Based on Frame Images with Dynamic Vision Sensor Modeling

An SNN-Based and Neuromorphic-Hardware-Implementable Noise Filter with Self-adaptive Time Window for Event-Based Vision Sensor.

DVDS: A deep visual dynamic slam system

Optical Flow for Spike Camera with Hierarchical Spatial-Temporal Spike Fusion

Adaptive spatio-temporal clustering for small object detection using event-based camera