Abstract:To enhance the accuracy of autonomous navigation in Unmanned Aerial Vehicles (UAVs) and boost their autonomous sensing and measuring abilities in challenging real-world flying scenarios. This paper focuses on the mapping process in autonomous navigation of UAVs. The work aims to solve the problems in traditional Oriented FAST and Rotated BRIEF (ORB) feature extraction algorithm where feature points are prone to accumulate in areas with rich texture, and the limitation of Oriented FAST and Rotated BRIEF - Simultaneous Localization and Mapping 3 (ORB-SLAM3) system to construct dense maps. An improved image stitching method of visual-inertial fusion for dense mapping is proposed based on ORB-SLAM3. And the proposed method uses the obtained panoramic images to create dense maps. Firstly, the Scale Invariant Feature Transform (SIFT) algorithm is utilized during feature point extraction. The Random Sample Consensus (RANSAC) algorithm is applied for feature point optimization to obtain the best feature points for matching. Secondly, combining the posture information obtained by IMU pre-integration and the visual information will be used to compensate for the errors caused by the speed of the UAV and different angles of aerial photography. Then eliminating redundant and repeated pixels, and stitching adjacent pictures will help to get a panoramic picture. Finally, generate a dense map from the sparse point cloud map generated by ORB-SLAM3. Experiments based on the AirSim are performed to validate the proposed method. The result shows that the SIFT feature extraction method outperforms other methods, the improved image stitching method can effectively eliminate ghosting and pixel information loss problems in various environments, and the dense maps can also be achieved.

Image Feature Extraction for Vision-Based UAV Navigation

A new stereo matching algorithm for UAV autonomous navigation

Realization of the Monocular Vision Odometry Based on Extracting Keypoints by SIFT in the Navigation System

A Visual Compass Based on Point and Line Features for UAV High-Altitude Orientation Estimation

L1-graph-based Image Matching Approach for UAV Navigation

Vision Navigation for UAV Based on Scene Matching

Self-localization of UAVs based on visual-inertial integrated navigation

An UAV navigation aided with computer vision

An Improved Image Stitching Method Based on Vision-Inertial Fusion

An Image-Guided Autonomous Navigation System for Multi-rotor UAVs

Real-time Detection and Tracking Method of Landmark Based on UAV Visual Navigation

UAV Localisation under Linear Mapping for Vision-Based Navigation.

An Area-Based Position and Attitude Estimation for Unmanned Aerial Vehicle Navigation

Research on UAV Autonomous Landing Integrated Navigation Based on Computer Vision/INS

Vision-based Navigation Feature Extraction for UAV at Night

Visual Saliency Landmark Detection Algorithm Based on DNN Feature Extraction

An Overview of Vision-Based UAV Navigation

Visual Information Assisted UAV Positioning Using Priori Remote-Sensing Information

Dynamic Key-Frame Based Airborne Scene Matching Vision Navigation

Cross-Modal Images Matching Based Enhancement to MEMS INS for UAV Navigation in GNSS Denied Environments

Multi-Region Scene Matching Based Localisation for Autonomous Vision Navigation of Uavs