Abstract:Existing voxel-hashing (VH)-based dense reconstruction methods have shown impressive results on datasets collected by hand-held cameras. Large-scale scenes are maintained with a truncated signed distance function (TSDF) volumetric representation. However, practically deploying such methods on low-cost embedded mobile robots remains challenging due to heavy computational burdens and various camera perception degeneration cases. In this work, we propose FROMFusion, a fast and robust on-manifold dense reconstruction framework based on multisensor fusion, which systematically solves how to align the point cloud with the hashed TSDF volume (HTV). Its purely geometric nature ensures the robustness to image motion blur and poor lighting conditions. To reduce memory overhead, we propose a spherical-coordinate-based HTV segmentation algorithm. To surmount missing geometric features, camera occlusion, and over range, a loosely coupled LiDAR-wheel-inertial odometry (LWIO) is applied for trustworthy initial guesses in camera pose optimization. At its core is a two-stage depth-to-HTV matching algorithm, which includes a coarse voxel-level pose ergodic search and a fine subvoxel-level Gauss-Newton (GN) solver with Anderson acceleration (AA) strategy for faster convergence. We evenly distribute heavy computational workloads to heterogeneous computing systems. Extensive field experiments on a low-cost wheeled robot cleaner demonstrate our method models continuous surfaces of large-scale scenes with high quality in both geometry and texture, outperforming current state-of-the-art methods in robustness to camera perception degeneration cases by a significant margin. The frame rate of online embedded implementation can reach up to 47.21 Hz maximum.

FragmentFusion: A Light-Weight SLAM Pipeline for Dense Reconstruction

FragmentFusion: A Light-Weight SLAM Pipeline for Dense Reconstruction

ElasticFusion: Real-time dense SLAM and light source estimation

GSFusion: Online RGB-D Mapping Where Gaussian Splatting Meets TSDF Fusion

A Framework for the Volumetric Integration of Depth Images

Real-time large-scale dense RGB-D SLAM with volumetric fusion

InstanceFusion: Real‐time Instance‐level 3D Reconstruction Using a Single RGBD Camera

SurfelWarp: Efficient Non-Volumetric Single View Dynamic Reconstruction

Scale-Consistent Fusion: From Heterogeneous Local Sampling to Global Immersive Rendering

Local Optimized and Scalable Frame-to-model SLAM

FlyFusion: Realtime Dynamic Scene Reconstruction Using a Flying Depth Camera

3DFusion, A real-time 3D object reconstruction pipeline based on streamed instance segmented data

RigidFusion: RGB‐D Scene Reconstruction with Rigidly‐moving Objects

FROMFusion: Fast and Robust On-Manifold Dense Reconstruction for Low-Cost Wheeled Robots

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

Real-time High Resolution Fusion of Depth Maps on GPU

Idfusion

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

Bodyfusion: Real-Time Capture Of Human Motion And Surface Geometry Using A Single Depth Camera

LF-fusion: Dense and Accurate 3D Reconstruction from Light Field Images

RoutedFusion: Learning Real-time Depth Map Fusion