Abstract:In this paper, we use computer vision as a feedback sensor in a control loop for landing an unmanned air vehicle (UAV) on a landing pad. The vision problem we address here is then a special case of the classic ego‐motion estimation problem since all feature points lie on a planar surface (the landing pad). We study together the discrete and differential versions of the ego‐motion estimation, in order to obtain both position and velocity of the UAV relative to the landing pad. After briefly reviewing existing algorithm for the discrete case, we present, in a unified geometric framework, a new estimation scheme for solving the differential case. We further show how the obtained algorithms enable the vision sensor to be placed in the feedback loop as a state observer for landing control. These algorithms are linear, numerically robust, and computationally inexpensive hence suitable for real‐time implementation. We present a thorough performance evaluation of the motion estimation algorithms under varying levels of image measurement noise, altitudes of the camera above the landing pad, and different camera motions relative to the landing pad. A landing controller is then designed for a full dynamic model of the UAV. Using geometric nonlinear control theory, the dynamics of the UAV are decoupled into an inner system and outer system. The proposed control scheme is then based on the differential flatness of the outer system. For the overall closed‐loop system, conditions are provided under which exponential stability can be guaranteed. In the closed‐loop system, the controller is tightly coupled with the vision based state estimation and the only auxiliary sensor are accelerometers for measuring acceleration of the UAV. Finally, we show through simulation results that the designed vision‐in‐the‐loop controller generates stable landing maneuvers even for large levels of image measurement noise. Experiments on a real UAV will be presented in future work.

Eagle Vision-Based Coordinate Landing Control Framework of Unmanned Aerial Vehicles on an Unmanned Surface Vehicle

Vision-based Autonomous Landing of Unmanned Aerial Vehicle on a Motional Unmanned Surface Vessel

Robust Autonomous Landing Control for UAV-USV Cooperative Platform: A New Control Framework Via the DETM

A Vision-Based Autonomous Landing Guidance Strategy for a Micro-UAV by the Modified Camera View

A UAV Autonomous Landing System Integrating Locating, Tracking, and Landing in the Wild Environment

An Integrated UWB-IMU-Vision Framework for Autonomous Approaching and Landing of UAVs

Synchronized Motion-Based UAV–USV Cooperative Autonomous Landing

Eagle-Vision-Inspired Visual Measurement Algorithm for UAV's Autonomous Landing.

Visual Navigation and Landing Control of an Unmanned Aerial Vehicle on a Moving Autonomous Surface Vehicle via Adaptive Learning

A Vision-Based Algorithm for Landing Unmanned Aerial Vehicles

Autonomous Landing of Quadrotor Unmanned Aerial Vehicles Based on Multi-Level Marker and Linear Active Disturbance Reject Control

Proactive Guidance for Accurate UAV Landing on a Dynamic Platform: A Visual–Inertial Approach

Coordinated Landing Control for Cross-Domain UAV-USV Fleets Using Heterogeneous-Feature Matching

Research on Vision-based Autonomous Landing of Unmanned Aerial Vehicle

Localization Framework for Real-Time Uav Autonomous Landing: an On-Ground Deployed Visual Approach

Simultaneous Obstacles Avoidance and Robust Autonomous Landing of a UAV on a Moving Vehicle

Vision-Based UAV Landing with Guaranteed Reliability in Adverse Environment

Research on Aerial Autonomous Docking and Landing Technology of Dual Multi-Rotor UAV

Vision-based Autonomous Landing Control of a Multi-rotor Aerial Vehicle on a Moving Platform with Experimental Validations

Autonomous Landing Of A Quadrotor On An Ugv

LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL