Abstract:In this paper, we use computer vision as a feedback sensor in a control loop for landing an unmanned air vehicle (UAV) on a landing pad. The vision problem we address here is then a special case of the classic ego‐motion estimation problem since all feature points lie on a planar surface (the landing pad). We study together the discrete and differential versions of the ego‐motion estimation, in order to obtain both position and velocity of the UAV relative to the landing pad. After briefly reviewing existing algorithm for the discrete case, we present, in a unified geometric framework, a new estimation scheme for solving the differential case. We further show how the obtained algorithms enable the vision sensor to be placed in the feedback loop as a state observer for landing control. These algorithms are linear, numerically robust, and computationally inexpensive hence suitable for real‐time implementation. We present a thorough performance evaluation of the motion estimation algorithms under varying levels of image measurement noise, altitudes of the camera above the landing pad, and different camera motions relative to the landing pad. A landing controller is then designed for a full dynamic model of the UAV. Using geometric nonlinear control theory, the dynamics of the UAV are decoupled into an inner system and outer system. The proposed control scheme is then based on the differential flatness of the outer system. For the overall closed‐loop system, conditions are provided under which exponential stability can be guaranteed. In the closed‐loop system, the controller is tightly coupled with the vision based state estimation and the only auxiliary sensor are accelerometers for measuring acceleration of the UAV. Finally, we show through simulation results that the designed vision‐in‐the‐loop controller generates stable landing maneuvers even for large levels of image measurement noise. Experiments on a real UAV will be presented in future work.

Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment

Intelligent Vision-based Autonomous Ship Landing Of VTOL UAVs

A Vision-based UAV Tracker Aiming at Aerial Targets

An Integrated Visual System for Unmanned Aerial Vehicles Tracking and Landing on the Ground Vehicles

Robust Reinforcement Learning Algorithm for Vision-based Ship Landing of UAVs

A fast, lightweight deep learning vision pipeline for autonomous UAV landing support with added robustness

Vision based hardware-software real-time control system for autonomous landing of an UAV

The Object Recognition and Adaptive Threshold Selection in the Vision System for Landing an Unmanned Aerial Vehicle

A Vision-Based Algorithm for Landing Unmanned Aerial Vehicles

Towards a Fully Autonomous UAV Controller for Moving Platform Detection and Landing

Vision-Based Target Detection and Tracking System for a Quadcopter

LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

A Method for Designated Target Anti-Interference Tracking Combining YOLOv5 and SiamRPN for UAV Tracking and Landing Control

Real‐time visual tracking design for an unmanned aerial vehicle in cluttered environments

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Target Detection, Tracking and Avoidance System for Low-cost UAVs using AI-Based Approaches

Proactive Guidance for Accurate UAV Landing on a Dynamic Platform: A Visual–Inertial Approach

Vision Assisted Autonomous Landing of an Unmanned Aerial Vehicle.

Monocular visual autonomous landing system for quadcopter drones using software in the loop