Abstract:The International Journal of Robotics Research, Ahead of Print. In this paper, we propose a vision-based estimation method for autonomous landing of fixed-wing aircraft for Advanced Air Mobility. The concept of autonomous flight with minimal human intervention has gained significant interest with a particular focus on autonomous landing. The goal is to overcome the limitations of existing instrument landing systems and reduce reliance on GNSS during aircraft landing. The proposed system leverages the following techniques for high-performance and real-time operations in various real-world environments and during all stages of landing. A deep learning segmentation model was directly learned, created, and used for robust runway recognition performance against environmental changes around the runway. Algorithms were designed to adapt to different flight stages considering the varying information offered by image data when the aircraft is in mid-air and on the ground. The relative lateral position from the aircraft to the runway was estimated using bird's-eye-view conversion and inverse projection techniques instead of conventional perspective-n-point methods for reducing the recognition error occurring from the conversion between 2D image and 3D world. Finally, the mixed-precision technique was used for the segmentation model to improve inference speed and ensure real-time operation in real-world deployment. Estimation stability and reliability were improved by using a Kalman Filter to cope with sensor uncertainties caused by the real-world flight environment. Consequently, we show that the average error in the lateral position estimation by the proposed method is comparable to the accuracy of a single GNSS and demonstrate successful autonomous landing of our test aircraft with a set of flight tests.

A Multi-stage Precision Landing Method for Autonomous Evtol Based on Multi-marker Joint Localization

Overall Evtol Aircraft Design for Urban Air Mobility

Vision-guided autonomous landing of multirotor UAV on fixed landing marker

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Artificial Marker and MEMS IMU-Based Pose Estimation Method to Meet Multirotor UAV Landing Requirements

A Vision-Based Autonomous Landing Guidance Strategy for a Micro-UAV by the Modified Camera View

Videometric Terminal Guidance Method And System For Uav Accurate Landing

A Precision Drone Landing System using Visual and IR Fiducial Markers and a Multi-Payload Camera

Vision-based Autonomous Landing Control of a Multi-rotor Aerial Vehicle on a Moving Platform with Experimental Validations

Autonomous Landing Strategy for Micro-UAV with Mirrored Field-of-View Expansion

Height Estimation Method for Landing of Small Unmanned Helicopter Based on Monocular Vision

Multi-resolution Visual Positioning and Navigation Technique for Unmanned Aerial System Landing Assistance

Autonomous Landing of a Micro Aerial Vehicle on a Moving Platform Using a Composite Landmark

Autonomous Landing of Quadrotor Unmanned Aerial Vehicles Based on Multi-Level Marker and Linear Active Disturbance Reject Control

Research on Vision-based Autonomous Landing of Unmanned Aerial Vehicle

An estimation method for vision-based autonomous landing system for fixed wing aircraft

Control System for Vertical Take-Off and Landing Vehicle's Adaptive Landing Based on Multi-Sensor Data Fusion

Development and Experimental Verification of A Hybrid Vertical Take-Off and Landing (vtol) Unmanned Aerial Vehicle(Uav)

Eagle-Vision-Inspired Visual Measurement Algorithm for UAV's Autonomous Landing.

A UAV Autonomous Landing System Integrating Locating, Tracking, and Landing in the Wild Environment