Abstract:To enhance the accuracy of autonomous navigation in Unmanned Aerial Vehicles (UAVs) and boost their autonomous sensing and measuring abilities in challenging real-world flying scenarios. This paper focuses on the mapping process in autonomous navigation of UAVs. The work aims to solve the problems in traditional Oriented FAST and Rotated BRIEF (ORB) feature extraction algorithm where feature points are prone to accumulate in areas with rich texture, and the limitation of Oriented FAST and Rotated BRIEF - Simultaneous Localization and Mapping 3 (ORB-SLAM3) system to construct dense maps. An improved image stitching method of visual-inertial fusion for dense mapping is proposed based on ORB-SLAM3. And the proposed method uses the obtained panoramic images to create dense maps. Firstly, the Scale Invariant Feature Transform (SIFT) algorithm is utilized during feature point extraction. The Random Sample Consensus (RANSAC) algorithm is applied for feature point optimization to obtain the best feature points for matching. Secondly, combining the posture information obtained by IMU pre-integration and the visual information will be used to compensate for the errors caused by the speed of the UAV and different angles of aerial photography. Then eliminating redundant and repeated pixels, and stitching adjacent pictures will help to get a panoramic picture. Finally, generate a dense map from the sparse point cloud map generated by ORB-SLAM3. Experiments based on the AirSim are performed to validate the proposed method. The result shows that the SIFT feature extraction method outperforms other methods, the improved image stitching method can effectively eliminate ghosting and pixel information loss problems in various environments, and the dense maps can also be achieved.

An UAV navigation aided with computer vision

A new stereo matching algorithm for UAV autonomous navigation

Vision Navigation for UAV Based on Scene Matching

Self-localization of UAVs based on visual-inertial integrated navigation

Integrated Vision/inertial Navigation Method of UAVs in Indoor Environment

Visual Odometry and Scene Matching Integrated Navigation System in UAV.

A Visual Compass Based on Point and Line Features for UAV High-Altitude Orientation Estimation

An Image-Guided Autonomous Navigation System for Multi-rotor UAVs

UAV Autonomous Navigation System for GNSS Invalidation

Visual-Inertial Tightly Coupled Fusion and Nonlinear Optimization for UAVs Navigation

Design and Implementation of Indoor Visual Autonomous Navigation System for Quadrotor UAV Based on Binocular Camera and IMU

An Overview of Vision-Based UAV Navigation

Vision-Aided Inertial Navigation for Small Unmanned Aerial Vehicles in GPS-Denied Environments

Visual Navigation for UAV Using Optical Flow Estimation

A survey on vision-based UAV navigation

Semi-physical Simulation Based on Scene Matching and Inertial Integrated Navigation for UAV

UAV Vision Aided INS/Odometer Integration for Land Vehicle Autonomous Navigation

Research on UAV Autonomous Landing Integrated Navigation Based on Computer Vision/INS

Vision-based autonomous landing integrated navigation scheme of unmanned combat aerial vehicles

An Improved Image Stitching Method Based on Vision-Inertial Fusion

A Multi-source Fused Location Estimation Method for UAV Based on Machine Vision and Strapdown Inertial Navigation