Abstract:Swarming is one of the important trends in the development of small multi-rotor UAVs. The stable operation of UAV swarms and air-to-ground cooperative operations depend on precise relative position information within the swarm. Existing relative localization solutions mainly rely on passively received external information or expensive and complex sensors, which are not applicable to the application scenarios of small-rotor UAV swarms. Therefore, we develop a relative localization solution based on airborne monocular sensing data to directly realize real-time relative localization among UAVs. First, we apply the lightweight YOLOv8-pose target detection algorithm to realize the real-time detection of quadcopter UAVs and their rotor motors. Then, to improve the computational efficiency, we make full use of the geometric properties of UAVs to derive a more adaptable algorithm for solving the P3P problem. In order to solve the multi-solution problem when less than four motors are detected, we analytically propose a positive solution determination scheme based on reasonable attitude information. We also introduce the maximum weight of the motor-detection confidence into the calculation of relative localization position to further improve the accuracy. Finally, we conducted simulations and practical experiments on an experimental UAV. The experimental results verify the feasibility of the proposed scheme, in which the performance of the core algorithm is significantly improved over the classical algorithm. Our research provides viable solutions to free UAV swarms from external information dependence, apply them to complex environments, improve autonomous collaboration, and reduce costs.

Estimating Orientation in Tracking Individuals of Flying Swarms

Tracking the 3D Position and Orientation of Flying Swarms with Learned Kinematic Pattern Using LSTM Network.

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Estimating Orientation of Flying Fruit Flies

Automatic 3D Tracking System for Large Swarm of Moving Objects

A Novel Method For Tracking Individuals Of Fruit Fly Swarms Flying In A Laboratory Flight Arena

Automated 3D trajectory measuring of large numbers of moving particles

Acquiring 3D motion trajectories of large numbers of swarming animals

Reconstructing 3D Motion Trajectory of Large Swarm of Flying Objects

3d Tracking Targets Via Kinematic Model Weighted Particle Filter

A Vision-based UAV Tracker Aiming at Aerial Targets

FACT: Fast and Active Coordinate Initialization for Vision-based Drone Swarms

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Viewpoint placement optimization for binocular three-dimensional trajectory measurement of translating and rotating particle swarms

Group Target Tracking for Highly Maneuverable Unmanned Aerial Vehicles Swarms: A Perspective

Preserving Relative Localization of FoV-Limited Drone Swarm via Active Mutual Observation

Relative Localization within a Quadcopter Unmanned Aerial Vehicle Swarm Based on Airborne Monocular Vision

Omni-swarm: A Decentralized Omnidirectional Visual-Inertial-UWB State Estimation System for Aerial Swarms

Agile Formation Control of Drone Flocking Enhanced With Active Vision-Based Relative Localization