Abstract:In this paper, a visual navigation method based on binocular vision and a deep learning approach is proposed to solve the navigation problem of the unmanned aerial vehicle autonomous aerial refueling docking process. First, to meet the requirements of high accuracy and high frame rate in aerial refueling tasks, this paper proposes a single-stage lightweight drogue detection model, which greatly increases the inference speed of binocular images by introducing image alignment and depth-separable convolution and improves the feature extraction capability and scale adaptation performance of the model by using an efficient attention mechanism (ECA) and adaptive spatial feature fusion method (ASFF). Second, this paper proposes a novel method for estimating the pose of the drogue by spatial geometric modeling using optical markers, and further improves the accuracy and robustness of the algorithm by using visual reprojection. Moreover, this paper constructs a visual navigation vision simulation and semi-physical simulation experiments for the autonomous aerial refueling task, and the experimental results show the following: (1) the proposed drogue detection model has high accuracy and real-time performance, with a mean average precision (mAP) of 98.23% and a detection speed of 41.11 FPS in the embedded module; (2) the position estimation error of the proposed visual navigation algorithm is less than ±0.1 m, and the attitude estimation error of the pitch and yaw angle is less than ±0.5°; and (3) through comparison experiments with the existing advanced methods, the positioning accuracy of this method is improved by 1.18% compared with the current advanced methods.

Robust Cooperative Target Detection for a Vision-Based UAVs Autonomous Aerial Refueling Platform Via the Contrast Sensitivity Mechanism of Eagle's Eye

Target Detection and Localization for Flapping-Wing Robots Based on Biological Eagle-Eye Vision

Target detection approach for UAV via Hybrid Model

A Monocular Visual Measurement System for UAV Probe-and-drogue Autonomous Aerial Refueling

Vision Sensor for Measuring Aerial Refueling Drogue Using Robust Method

Research of an Unmanned Aerial Vehicle Autonomous Aerial Refueling Docking Method Based on Binocular Vision

Eagle-Vision-Inspired Visual Measurement Algorithm for UAV's Autonomous Landing.

Unmanned Aerial Vehicle Recognition of Maritime Small-Target Based on Biological Eagle-Eye Vision Adaptation Mechanism

Maritime Target Saliency Detection for UAV Based on the Stimulation Competition Selection Mechanism of Raptor Vision

A Vision-based UAV Tracker Aiming at Aerial Targets

Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective

Robust Detection Algorithm with Triple Constraints for Cooperative Target Based on Spectral Residual

Vision-based multi-agent cooperative target search

Research on Aerial Photography Target Detection Methods

Multiple-Target Matching Algorithm for SAR and Visible Light Image Data Captured by Multiple Unmanned Aerial Vehicles

A Binocular Vision-Based UAVs Autonomous Aerial Refueling Platform

A Method of Visual Sensor Employment Planning for UAV Target Detection

Visual Measurement in Simulation Environment for Vision-Based UAV Autonomous Aerial Refueling

Robust detection and matching algorithm oriented to near infrared cooperative objects

A Lightweight Eagle-Eye-Based Vision System for Target Detection and Recognition

Unmanned Aerial Vehicles Target Detection Based on Bio-inspired Visual Attention