Abstract:In this paper, we use computer vision as a feedback sensor in a control loop for landing an unmanned air vehicle (UAV) on a landing pad. The vision problem we address here is then a special case of the classic ego‐motion estimation problem since all feature points lie on a planar surface (the landing pad). We study together the discrete and differential versions of the ego‐motion estimation, in order to obtain both position and velocity of the UAV relative to the landing pad. After briefly reviewing existing algorithm for the discrete case, we present, in a unified geometric framework, a new estimation scheme for solving the differential case. We further show how the obtained algorithms enable the vision sensor to be placed in the feedback loop as a state observer for landing control. These algorithms are linear, numerically robust, and computationally inexpensive hence suitable for real‐time implementation. We present a thorough performance evaluation of the motion estimation algorithms under varying levels of image measurement noise, altitudes of the camera above the landing pad, and different camera motions relative to the landing pad. A landing controller is then designed for a full dynamic model of the UAV. Using geometric nonlinear control theory, the dynamics of the UAV are decoupled into an inner system and outer system. The proposed control scheme is then based on the differential flatness of the outer system. For the overall closed‐loop system, conditions are provided under which exponential stability can be guaranteed. In the closed‐loop system, the controller is tightly coupled with the vision based state estimation and the only auxiliary sensor are accelerometers for measuring acceleration of the UAV. Finally, we show through simulation results that the designed vision‐in‐the‐loop controller generates stable landing maneuvers even for large levels of image measurement noise. Experiments on a real UAV will be presented in future work.

State Estimation in Visual Inertial Autonomous Helicopter Landing Using Optimisation on Manifold

Inertial-aided State and Slope Estimation Using a Monocular Camera

A Method of Vision-Based State Estimation of an Unmanned Helicopter

STEREO VISION-BASED ESTIMATION OF POSE AND MOTION FOR AUTONOMOUS LANDING OF AN UNMANNED HELICOPTER

Height Estimation Method for Landing of Small Unmanned Helicopter Based on Monocular Vision

LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL

Monocular Snapshot-based Sensing and Control of Hover, Takeoff, and Landing for a Low-cost Quadrotor

A Generalized Kalman Filter Augmented Deep-Learning based Approach for Autonomous Landing in MAVs

Inertial-Aided Metric States and Surface Normal Estimation Using a Monocular Camera.

Metric Sensing and Control of a Quadrotor Using a Homography-Based Visual Inertial Fusion Method.

Towards Non-Robocentric Dynamic Landing of Quadrotor UAVs

State estimation of micro autonomous helicopter based on computer vision

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

An estimation method for vision-based autonomous landing system for fixed wing aircraft

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

Robust Visual Inertial Monocular Using Nonlinear Optimization.

A progressive online external parameter calibration and initialization method for stereo-IMU system

Real-Time Optimal States Estimation with Inertial and Delayed Visual Measurements for Unmanned Aerial Vehicles

Certified Vision-based State Estimation for Autonomous Landing Systems using Reachability Analysis

Visual Environment Assessment for Safe Autonomous Quadrotor Landing