Abstract:Using unmanned aerial vehicles (UAVs) for remote sensing has the advantages of high flexibility, convenient operation, low cost, and wide application range. It fills the need for rapid acquisition of high-resolution aerial images in modern photogrammetry applications. Due to the insufficient parallaxes and the computation-intensive process, dense real-time reconstruction for large terrain scenes is a considerable challenge. To address these problems, we proposed a novel SLAM-based MVS (Multi-View-Stereo) approach, which can incrementally generate a dense 3D (three-dimensional) model of the terrain by using the continuous image stream during the flight. The pipeline of the proposed methodology starts with pose estimation based on SLAM algorithm. The tracked frames were then selected by a novel scene-adaptive keyframe selection method to construct a sliding window frame-set. This was followed by depth estimation using a flexible search domain approach, which can improve accuracy without increasing the iterate time or memory consumption. The whole system proposed in this study was implemented on the embedded GPU based on an UAV platform. We proposed a highly parallel and memory-efficient CUDA-based depth computing architecture, enabling the system to achieve good real-time performance. The evaluation experiments were carried out in both simulation and real-world environments. A virtual large terrain scene was built using the Gazebo simulator. The simulated UAV equipped with an RGB-D camera was used to obtain synthetic evaluation datasets, which were divided by flight altitudes (800-, 1000-, 1200 m) and terrain height difference (100-, 200-, 300 m). In addition, the system has been extensively tested on various types of real scenes. Comparison with commercial 3D reconstruction software is carried out to evaluate the precision in real-world data. According to the results on the synthetic datasets, over 93.462% of the estimation with absolute error distance of less then 0.9%. In the real-world dataset captured at 800 m flight height, more than 81.27% of our estimated point cloud are less then 5 m difference with the results of Photoscan. All evaluation experiments show that the proposed approach outperforms the state-of-the-art ones in terms of accuracy and efficiency.

Integrating a LiDAR Sensor in a UAV Platform to Obtain a Georeferenced Point Cloud

INTEGRATION BETWEEN UNMANNED AERIAL VEHICLE AND TERRESTRIAL LASER SCANNER IN PRODUCING 3D MODEL

A GNSS/INS/LiDAR Integration Scheme for UAV-Based Navigation in GNSS-Challenging Environments

Hybrid georeferencing of images and LiDAR data for UAV-based point cloud collection at millimetre accuracy

Designing and Testing a UAV Mapping System for Agricultural Field Surveying

The development of an UAV borne direct georeferenced photogrammetric platform for Ground Control Point free applications

Comprehensive Direct Georeferencing of Aerial Images for Unmanned Aerial Systems Applications

Development of a UAV-LiDAR System with Application to Forest Inventory

In-Situ Calibration and Trajectory Enhancement of UAV LiDAR Systems for Mapping Mechanized Agricultural Fields

INTEGRATION OF UAV-LIDAR AND UAV-PHOTOGRAMMETRY FOR INFRASTRUCTURE MONITORING AND BRIDGE ASSESSMENT

Design and Experimental Study on an Innovative UAV-LiDAR Topographic Mapping System for Precision Land Levelling

Digital topographic mapping and modelling using low altitude unmanned aerial vehicle

Seamless integration of above- and under-canopy unmanned aerial vehicle laser scanning for forest investigation

Is it possible to generate accurate 3D point clouds with UAS-LIDAR and UAS-RGB photogrammetry without GCPs? A case study on a beach and rocky cliff

The Integration of Uavand Backpack Lidar Systems for Forest Inventory.

Use of Information From the Digital Elevation Model in Autonomous Air Navigation Based on Image Odometry

UAV Tracking with Lidar as a Camera Sensors in GNSS-Denied Environments

Development and Testing of a UAV Laser Scanner and Multispectral Camera System for Eco-Geomorphic Applications

UAV and terrestrial laser scanner data processing for large scale topographic mapping

Onboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform

Robust Visual-Lidar Simultaneous Localization and Mapping System for UAV