Abstract:The International Journal of Robotics Research, Ahead of Print. In this paper, we propose a vision-based estimation method for autonomous landing of fixed-wing aircraft for Advanced Air Mobility. The concept of autonomous flight with minimal human intervention has gained significant interest with a particular focus on autonomous landing. The goal is to overcome the limitations of existing instrument landing systems and reduce reliance on GNSS during aircraft landing. The proposed system leverages the following techniques for high-performance and real-time operations in various real-world environments and during all stages of landing. A deep learning segmentation model was directly learned, created, and used for robust runway recognition performance against environmental changes around the runway. Algorithms were designed to adapt to different flight stages considering the varying information offered by image data when the aircraft is in mid-air and on the ground. The relative lateral position from the aircraft to the runway was estimated using bird's-eye-view conversion and inverse projection techniques instead of conventional perspective-n-point methods for reducing the recognition error occurring from the conversion between 2D image and 3D world. Finally, the mixed-precision technique was used for the segmentation model to improve inference speed and ensure real-time operation in real-world deployment. Estimation stability and reliability were improved by using a Kalman Filter to cope with sensor uncertainties caused by the real-world flight environment. Consequently, we show that the average error in the lateral position estimation by the proposed method is comparable to the accuracy of a single GNSS and demonstrate successful autonomous landing of our test aircraft with a set of flight tests.

Laser-Assisted Guidance Landing Technology for Drones

Research on Dynamic Landing Guidance Algorithm for the Maritime Quadrotor

Proactive Guidance for Accurate UAV Landing on a Dynamic Platform: A Visual–Inertial Approach

AIRA: A Low-cost IR-based Approach Towards Autonomous Precision Drone Landing and NLOS Indoor Navigation

A Ground-Based Near Infrared Camera Array System for UAV Auto-Landing in GPS-Denied Environment

A Multi-stage Precision Landing Method for Autonomous Evtol Based on Multi-marker Joint Localization

Robust Autonomous Landing of UAV in Non-Cooperative Environments based on Dynamic Time Camera-LiDAR Fusion

A Precision Drone Landing System using Visual and IR Fiducial Markers and a Multi-Payload Camera

Vision-guided autonomous landing of multirotor UAV on fixed landing marker

Target Localization for Autonomous Landing Site Detection: A Review and Preliminary Result with Static Image Photogrammetry

A Generalized Kalman Filter Augmented Deep-Learning based Approach for Autonomous Landing in MAVs

Remote Marker-Based Tracking for UAV Landing Using Visible-Light Camera Sensor

Error Reduction in Vision-Based Multirotor Landing System

Robust Autonomous Landing of UAVs in Non-Cooperative Environments Based on Comprehensive Terrain Understanding

Monocular visual autonomous landing system for quadcopter drones using software in the loop

Acoustic Localization System for Precise Drone Landing

A fast, lightweight deep learning vision pipeline for autonomous UAV landing support with added robustness

An estimation method for vision-based autonomous landing system for fixed wing aircraft

Using Reinforcement Learning and Error Models for Drone Precise Landing

Detection and Localization of Thin Vertical Board for UAV Perching

Vision-aided Automatic Landing Design for Small Twin-engine Fixed Wing UAV