Abstract:In recent years, the rapid development of unmanned aerial vehicle (UAV) technologies has made data acquisition increasingly convenient, and three-dimensional (3D) reconstruction has emerged as a popular subject of research in this context. These 3D models have many advantages, such as the ability to represent realistic scenes and a large amount of information. However, traditional 3D reconstruction methods are expensive, and require long and complex processing. As a result, they cannot rapidly respond when used in time-sensitive applications, e.g., those for such natural disasters as earthquakes, debris flow, etc. Computer vision-based simultaneous localization and mapping (SLAM) along with hardware development based on embedded systems, can provide a solution to this problem. Based on an analysis of the principle and implementation of the visual SLAM algorithm, this study proposes a fast method to quickly reconstruct a dense 3D point cloud model on a UAV platform combined with an embedded graphics processing unit (GPU). The main contributions are as follows: (1) to resolve the contradiction between the resource limitations and the computational complexity of visual SLAM on UAV platforms, the technologies needed to compute resource allocation, communication between nodes, and data transmission and visualization in an embedded environment were investigated to achieve real-time data acquisition and processing. Visual monitoring to this end is also designed and implemented. (2) To solve the problem of time-consuming algorithmic processing, a corresponding parallel algorithm was designed and implemented based on the parallel programming framework of the compute unified device architecture (CUDA). (3) The visual odometer and methods of 3D “map” reconstruction were designed using under a monocular vision sensor to implement the prototype of the fast 3D reconstruction system. Based on preliminary results of the 3D modeling, the following was noted: (1) the proposed method was feasible. By combining UAV, SLAM, and parallel computing, a simple and efficient 3D reconstruction model of an unknown area was obtained for specific applications. (2) The parallel SLAM algorithm used in this method improved the efficiency of the SLAM algorithm. On the one hand, the SLAM algorithm required 1/6 of the time taken by the structure-from-motion algorithm. On the other hand, the speedup obtained using the parallel SLAM algorithm based on the embedded GPU on our test platform was 7.55 × that of the serial algorithm. (3) The depth map results show that the effective pixel with an error less than 15cm is close to 60%.

3D-SLAM Implementation on Commercial UAV: Challenges and Future Insights

Real-time, dense UAV mapping by leveraging monocular depth prediction with monocular-inertial SLAM

Densifying SLAM for UAV Navigation by Fusion of Monocular Depth Prediction

Monocular Depth Estimation for Autonomous UAV Navigation Based on Deep Learning

Fast Reconstruction of 3D Point Cloud Model Using Visual SLAM on Embedded UAV Development Platform

CNN-Based Dense Monocular Visual SLAM for Real-Time UAV Exploration in Emergency Conditions

Monocular-GPS Fusion 3D Object Detection for UAVs

Unmanned Aerial Vehicle Visual Simultaneous Localization and Mapping: A Survey

The Collaborative Mapping and Navigation Based on Visual SLAM in UAV Platform

Onboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform

UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments

Visual SLAM for Unmanned Aerial Vehicles: Localization and Perception

Robust Visual-Lidar Simultaneous Localization and Mapping System for UAV

Delayed Monocular SLAM Approach Applied to Unmanned Aerial Vehicles

Real-time dense 3D Reconstruction from monocular video data captured by low-cost UAVs

SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

A Monocular Inertial UAV SLAM Algorithm Leveraging Feature Clustering

A review of SLAM techniques and applications in unmanned aerial vehicles

2-D UAV navigation solution with LIDAR sensor under GPS-denied environment

Learning to SLAM on the Fly in Unknown Environments: A Continual Learning Approach for Drones in Visually Ambiguous Scenes

Monocular Visual SLAM Based on a Cooperative UAV-Target System