Abstract:In the recent years, visual navigation has been considered an effective mechanism for achieving an autonomous landing of Unmanned Aerial Vehicles (UAVs). Nevertheless, with the limitations of visual cameras, the effectiveness of visual algorithms is significantly limited by lighting conditions. Therefore, a novel vision-based autonomous landing navigation scheme is proposed for night-time autonomous landing of fixed-wing UAV. Firstly, due to the difficulty of detecting the runway caused by the low-light image, a strategy of visible and infrared image fusion is adopted. The objective functions of the fused and visible image, and the fused and infrared image, are established. Then, the fusion problem is transformed into the optimal situation of the objective function, and the optimal solution is realized by gradient descent schemes to obtain the fused image. Secondly, to improve the performance of detecting the runway from the enhanced image, a runway detection algorithm based on an improved Faster region-based convolutional neural network (Faster R-CNN) is proposed. The runway ground-truth box of the dataset is statistically analyzed, and the size and number of anchors in line with the runway detection background are redesigned based on the analysis results. Finally, a relative attitude and position estimation method for the UAV with respect to the landing runway is proposed. New coordinate reference systems are established, six landing parameters, such as three attitude and three positions, are further calculated by Orthogonal Iteration (OI). Simulation results reveal that the proposed algorithm can achieve 1.85% improvement of AP on runway detection, and the reprojection error of rotation and translation for pose estimation are 0.675∘ and 0.581%, respectively.

An image‐based runway detection method for fixed‐wing aircraft based on deep neural network

YOMO-Runwaynet: A Lightweight Fixed-Wing Aircraft Runway Detection Algorithm Combining YOLO and MobileRunwaynet

Framework for Runway's True Heading Extraction in Remote Sensing Images Based on Deep Learning and Semantic Constraints

A Saliency-Aware Deep Network for Narrow Road Extraction of High-Resolution Remote Sensing Imagery

Deep learning-based foreign object detection method for aviation runways

Runway Detection Using Line Segment Statistical Model

A Deep Neural Networks Approach for Pixel-Level Runway Pavement Crack Segmentation Using Drone-Captured Images

SEL-Net: A Self-Supervised Learning-Based Network for PolSAR Image Runway Region Detection

VALNet: Vision-Based Autonomous Landing with Airport Runway Instance Segmentation

Runway Visual Range Prediction Based on Ensemble Learning

Recognition of void defects in airport runways using ground-penetrating radar and shallow CNN

FOD Detection using DenseNet with Focal Loss of Object Samples for Airport Runway

A Multi-Feature Fusion-Based Method for Crater Extraction of Airport Runways in Remote-Sensing Images

Airport runway detection based on long linear structure

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Validation of Global Airport Spatial Locations From Open Databases Using Deep Learning for Runway Detection

Visual Navigation Algorithm for Night Landing of Fixed-Wing Unmanned Aerial Vehicle

Airport detection in remote sensing real-open world using deep learning

Foreign Object Debris Detection for Airport Pavement Images Based on Image Random Masking and Semantic Feature Matching

A Novel Parallel Algorithm for Airport Runway Segmentation in Satellite Images Using Priority Directional Region Growing Strategy Based on Ensemble Learning.

A method of automatic finding airport runways in aerial images