Abstract:Existing voxel-hashing (VH)-based dense reconstruction methods have shown impressive results on datasets collected by hand-held cameras. Large-scale scenes are maintained with a truncated signed distance function (TSDF) volumetric representation. However, practically deploying such methods on low-cost embedded mobile robots remains challenging due to heavy computational burdens and various camera perception degeneration cases. In this work, we propose FROMFusion, a fast and robust on-manifold dense reconstruction framework based on multisensor fusion, which systematically solves how to align the point cloud with the hashed TSDF volume (HTV). Its purely geometric nature ensures the robustness to image motion blur and poor lighting conditions. To reduce memory overhead, we propose a spherical-coordinate-based HTV segmentation algorithm. To surmount missing geometric features, camera occlusion, and over range, a loosely coupled LiDAR-wheel-inertial odometry (LWIO) is applied for trustworthy initial guesses in camera pose optimization. At its core is a two-stage depth-to-HTV matching algorithm, which includes a coarse voxel-level pose ergodic search and a fine subvoxel-level Gauss-Newton (GN) solver with Anderson acceleration (AA) strategy for faster convergence. We evenly distribute heavy computational workloads to heterogeneous computing systems. Extensive field experiments on a low-cost wheeled robot cleaner demonstrate our method models continuous surfaces of large-scale scenes with high quality in both geometry and texture, outperforming current state-of-the-art methods in robustness to camera perception degeneration cases by a significant margin. The frame rate of online embedded implementation can reach up to 47.21 Hz maximum.

FROMFusion: Fast and Robust On-Manifold Dense Reconstruction for Low-Cost Wheeled Robots

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

HeteroFusion: Dense Scene Reconstruction Integrating Multi-Sensors.

OwlFusion: Depth-Only Onboard Real-Time 3D Reconstruction of Scalable Scenes for Fast-Moving MAV

Chunkfusion: A Learning-Based RGB-D 3D Reconstruction Framework Via Chunk-Wise Integration

Off-Fusion: Robust LiDAR Fusion for Complex Off-Road Scenes

Coxgraph: Multi-Robot Collaborative, Globally Consistent, Online Dense Reconstruction System

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction

FastFusion: Real-Time Indoor Scene Reconstruction with Fast Sensor Motion

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

DenseFusion: Large-Scale Online Dense Pointcloud and DSM Mapping for UAVs

A Real-Time and Globally Consistent Meshing Reconstruction Without GPU.

HVOFusion: Incremental Mesh Reconstruction Using Hybrid Voxel Octree

RigidFusion: RGB‐D Scene Reconstruction with Rigidly‐moving Objects

RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream

Fusion of Auxiliary Imaging Information for Robust, Scalable and Fast 3D Reconstruction.

ClusterFusion: Real-time Relative Positioning and Dense Reconstruction for UAV Cluster

DISORF: A Distributed Online 3D Reconstruction Framework for Mobile Robots

A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction

Feature-Based Direct Tracking and Mapping for Real-Time Noise-Robust Outdoor 3D Reconstruction Using Quadcopters