Abstract:In numerous robotic and autonomous driving tasks, traditional visual SLAM algorithms estimate the camera's position in a scene through sparse feature points and express the map by estimating the depth of sparse point clouds. However, practical applications require SLAM to create dense maps in real time, overcoming the sparsity and occlusion issues of point clouds. Furthermore, it is advantageous for SLAM map to possess an auto-completion capability, where the map can automatically infer and complete the remaining 20% when the camera observes only 80% of an object. Therefore, a more dense and intelligent map representation is needed. In this paper, we propose a Visual–Inertial SLAM with Neural Radiance Fields reconstruction to address the aforementioned challenges. We integrate the traditional rule-based optimization with NeRF. This approach allows for the real-time update of NeRF local functions by rapidly estimating camera motion and sparse feature point depths to reconstruct 3D scenes. To achieve better camera poses and globally consistent map, we address the issue of IMU noise spikes resulting from rapid motion changes, along with handling pose adjustments due to loop closure fusion. Specifically, we employ a form of widening the static noise covariance to refit the dynamic noise covariance. During loop closure fusion, we treat the pose adjustment between pre- and post-loop closure as a spatiotemporal transformation, migrating NeRF parameters from pre- to post- to expedite loop closure adjustments in NeRF mapping. Moreover, we extend this method to scenarios with only grayscale images. By expanding the color channels of grayscale images and conducting linear spatial mapping, we can rapidly reconstruct 3D scenes with only grayscale images. We demonstrate the precision and speed advantages of our method in both RGB and grayscale scenes.

Research on Visual SLAM System Based on Near-Infrared Perception

Direct Near-Infrared-Depth Visual SLAM With Active Lighting

SLAM in Low-Light Environments Based on Infrared-Visible Light Fusion

A robust stereo feature-aided semi-direct SLAM system

Laser Map Aided Visual Inertial Localization in Changing Environment.

LI-SLAM: Fusing LiDAR and Infrared Camera for Simultaneous Localization and Mapping

Thermal-Inertial SLAM for the Environments With Challenging Illumination

EIL‐SLAM: Depth‐enhanced edge‐based infrared‐LiDAR SLAM

VI-NeRF-SLAM: a real-time visual–inertial SLAM with NeRF mapping

Sparse Depth Enhanced Direct Thermal-Infrared SLAM Beyond the Visible Spectrum

Light-SLAM: A Robust Deep-Learning Visual SLAM System Based on LightGlue under Challenging Lighting Conditions

Monocular Vision SLAM Research for Parking Environment with Low Light

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

SuperVINS: A Real-Time Visual-Inertial SLAM Framework for Challenging Imaging Conditions

Robot Localization and Navigation Using Visible Light Positioning and SLAM Fusion

AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System

Semi-direct Monocular Visual and Visual-Inertial SLAM with Loop Closure Detection

Monocular Visual-Inertial Navigation for Dynamic Environment

NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understanding

Visual-Inertial-Laser SLAM Based on ORB-SLAM3