Abstract:In this paper, we use computer vision as a feedback sensor in a control loop for landing an unmanned air vehicle (UAV) on a landing pad. The vision problem we address here is then a special case of the classic ego‐motion estimation problem since all feature points lie on a planar surface (the landing pad). We study together the discrete and differential versions of the ego‐motion estimation, in order to obtain both position and velocity of the UAV relative to the landing pad. After briefly reviewing existing algorithm for the discrete case, we present, in a unified geometric framework, a new estimation scheme for solving the differential case. We further show how the obtained algorithms enable the vision sensor to be placed in the feedback loop as a state observer for landing control. These algorithms are linear, numerically robust, and computationally inexpensive hence suitable for real‐time implementation. We present a thorough performance evaluation of the motion estimation algorithms under varying levels of image measurement noise, altitudes of the camera above the landing pad, and different camera motions relative to the landing pad. A landing controller is then designed for a full dynamic model of the UAV. Using geometric nonlinear control theory, the dynamics of the UAV are decoupled into an inner system and outer system. The proposed control scheme is then based on the differential flatness of the outer system. For the overall closed‐loop system, conditions are provided under which exponential stability can be guaranteed. In the closed‐loop system, the controller is tightly coupled with the vision based state estimation and the only auxiliary sensor are accelerometers for measuring acceleration of the UAV. Finally, we show through simulation results that the designed vision‐in‐the‐loop controller generates stable landing maneuvers even for large levels of image measurement noise. Experiments on a real UAV will be presented in future work.

Identification of ground effect and intelligent control of unmanned aerial vehicles

Adaptive Attitude Control For An Unmanned Scale Helicopter In Hover

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Intelligent Position Controller for Unmanned Aerial Vehicles (UAV) Based on Supervised Deep Learning

A Hybrid Control Method for an Unmanned Scale Helicopter Attitude

Neural Network Based Model Predictive Control for a Quadrotor UAV

Deep Nonlinear Adaptive Control for Unmanned Aerial Systems Operating under Dynamic Uncertainties

Nonlinear Decoupled Control of Unmanned Aerial Vehicles

Control System for Vertical Take-Off and Landing Vehicle's Adaptive Landing Based on Multi-Sensor Data Fusion

Discrete-Time Adaptive Neural Tracking Control and Its Experiments for Quadrotor Unmanned Aerial Vehicle Systems

Deep Convolutional Identifier for Dynamic Modeling and Adaptive Control of Unmanned Helicopter.

Adaptive control for uncrewed aerial vehicles based on communication information optimization in complex environments

Research on the Control Method of Unmanned Helicopter Under the Background of Artificial Intelligence

Neural Network Adaptive Control For Small Unmanned Tandem Helicopter

A Varying-Parameter Adaptive Multi-Layer Neural Dynamic Method for Designing Controllers and Application to Unmanned Aerial Vehicles

Control Design of Autonomous Drone Using Deep Learning Based Image Understanding Techniques

LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Precision Landing of Unmanned Aerial Vehicle under Wind Disturbance Using Derivative Sliding Mode Nonlinear Disturbance Observer-Based Control Method

Neural Adaptive Distributed Formation Control of Nonlinear Multi-UAVs With Unmodeled Dynamics

System Identification and Nonlinear Model Predictive Control with Collision Avoidance Applied in Hexacopters UAVs