Abstract:The object recognition technology of unmanned aerial vehicles (UAVs) equipped with “You Only Look Once” (YOLO) has been validated in actual flights. However, here, the challenge lies in efficiently utilizing camera gimbal control technology to swiftly capture images of YOLO-identified target objects in aerial search missions. Enhancing the UAV’s energy efficiency and search effectiveness is imperative. This study aims to establish a simulation environment by employing the Unity simulation software for target tracking by controlling the gimbal. This approach involves the development of deep deterministic policy-gradient (DDPG) reinforcement-learning techniques to train the gimbal in executing effective tracking actions. The outcomes of the simulations indicate that when actions are appropriately rewarded or penalized in the form of scores, the reward value can be consistently converged within the range of 19–35. This convergence implies that a successful strategy leads to consistently high rewards. Consequently, a refined set of training procedures is devised, enabling the gimbal to accurately track the target. Moreover, this strategy minimizes unnecessary tracking actions, thus enhancing tracking efficiency. Numerous benefits arise from training in a simulated environment. For instance, the training in this simulated environment is facilitated through a dataset composed of actual flight photographs. Furthermore, offline operations can be conducted at any given time without any constraint of time and space. Thus, this approach effectively enables the training and enhancement of the gimbal’s action strategies. The findings of this study demonstrate that a coherent set of action strategies can be proficiently cultivated by employing DDPG reinforcement learning. Furthermore, these strategies empower the UAV’s gimbal to rapidly and precisely track designated targets. Therefore, this approach provides both convenience and opportunities to gather more flight-scenario training data in the future. This gathering of data will lead to immediate training opportunities and help improve the system’s energy consumption.

MTL-PIE: A Multi-task Learning Based Drone Pilot Identification and Operation Evaluation Scheme

A Trajectory-based Flight Assistive System for Novice Pilots in Drone Racing Scenario

A Multi-task Learning Framework for Drone State Identification and Trajectory Prediction

Learning to Assist and Communicate with Novice Drone Pilots for Expert Level Performance

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

An ID-Based Robust Identification Approach Toward Multitype Noncooperative Drones

Robust Multi-Drone Multi-Target Tracking to Resolve Target Occlusion: A Benchmark

DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objects

Multi-Task Regression-Based Learning for Autonomous Unmanned Aerial Vehicle Flight Control Within Unstructured Outdoor Environments

Digital Twin Assisted Task Assignment in Multi-UAV Systems: A Deep Reinforcement Learning Approach

MUSAK: A Multi-Scale Space Kinematic Method for Drone Detection

AirPilot: Interpretable PPO-based DRL Auto-Tuned Nonlinear PID Drone Controller for Robust Autonomous Flights

PILOT: High-Precision Indoor Localization for Autonomous Drones

Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization

Enhancing Drone Security Through Multi-Sensor Anomaly Detection and Machine Learning

Manipulating Camera Gimbal Positioning by Deep Deterministic Policy Gradient Reinforcement Learning for Drone Object Detection

SiamTADT: A Task-Aware Drone Tracker for Aerial Autonomous Vehicles

A Multi-task Transformer Architecture for Drone State Identification and Trajectory Prediction

Reliable Digital Forensics in the Air

Drone Detection and Tracking System Based on Fused Acoustical and Optical Approaches

FlockAI: A Testing Suite for ML-Driven Drone Applications