Abstract:The precise positioning issue of oblique aerial image has been widely studied in recent years. However, there are still some deficiencies in applying the existing methods to highly time-sensitive engineering. For the real-time positioning issues of oblique images involved in Unmanned Aerial Vehicle's (UAV's) patrolling applications, existing photogrammetry method cannot meet the real-time positioning requirements, existing binocular vision method cannot meet the dynamic and precise positioning requirements, existing optical flow method cannot meet the absolute positioning requirements, and existing multi-source feature matching method cannot meet the robust positioning requirements. In order to meet the real-time, dynamic, precise, absolute and robust positioning requirements of UAV's patrolling images, a real-time positioning model for UAV's patrolling images based on airborne LiDAR point cloud fusion is proposed. First , a precise Digital Surface Model (DSM) is generated by rasterizing and imaging the raw airborne LiDAR point cloud, in which a pixel's grayscale is exactly equal to elevation of local area covered by the pixel. Second , the generated DSM and UAV's patrolling image are fused under specific geometric constrains, so as to realize real-time positioning of UAV's patrolling image pixel by pixel. Finally , more precise positioning of selected key points on UAV's patrolling image can be realized by performing Principal Component Analysis (PCA)on the raw airborne LiDAR point cloud that surrounds the selected key points. The above methods are analyzed and verified by three groups of practical experiments, and results indicate that the proposed model can achieve real-time positioning of a single UAV's patrolling image (4000 × 6000 pixels) with an accuracy of 0.5 m within 0.38 seconds in arbitrary areas, and can further realize precise positioning of any selected key point on UAV's patrolling image with an accuracy of 0.2 m in 0.001 seconds.

Real-time Active Detection of Targets and Path Planning Using UAVs

Fast Detection and Recognition Method of UAV in Sky Background

A Vision-based UAV Tracker Aiming at Aerial Targets

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Real-Time Multi-Modal Active Vision for Object Detection on UAVs Equipped With Limited Field of View LiDAR and Camera

A Real-time Positioning Model for UAV's Patrolling Images Based on Airborne LiDAR Point Cloud Fusion

Adaptive Path Planning for UAVs for Multi-Resolution Semantic Segmentation

Real-time tracking a ground moving target in complex indoor and outdoor environments with UAV

Towards Autonomous Operation of UAVs Using Data-Driven Target Tracking and Dynamic, Distributed Path Planning Methods

Autonomous Obstacle Avoidance for UAV based on Point Cloud

Target recognition and tracking system based on UAV platform

A Robust and Efficient UAV Path Planning Approach for Tracking Agile Targets in Complex Environments

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

EF-TTOA: Development of a UAV Path Planner and Obstacle Avoidance Control Framework for Static and Moving Obstacles

UAV Based Indoor Localization and Objection Detection

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints

Adaptive Path Planning for UAV-based Multi-Resolution Semantic Segmentation

A Path Planning Method for Collaborative Coverage Monitoring in Urban Scenarios

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

Multitarget Real-Time Tracking Algorithm for UAV IoT