Abstract:This paper proposes an online predictive control method for fixed-wing unmanned aerial vehicles (UAVs) with a pan-tilt camera in target tracking. It aims to achieve long-term tracking while concurrently maintaining the target near the image center. Particularly, this work takes the UAV and pan-tilt camera as an overall system and deals with the target tracking problem via joint optimization, so that the tracking ability of the UAV can be improved. The image captured by the pan-tilt camera is the unique input associated with the target, and model predictive control (MPC) is used to solve the optimization problem with constraints that cannot be performed by the classic image-based visual servoing (IBVS). In addition to the dynamic constraint of the UAV, the perception constraint of the camera is also taken into consideration, which is described by the maximum distance between the target and the camera. The accurate detection of the target depends on the amount of its feature information contained in the image, which is highly related to the relative distance between the target and the camera. Moreover, considering the real-time requirements of practical applications, an MPC strategy based on soft constraints and a warm start is presented. Furthermore, a switching-based approach is proposed to return the target back to the perception range quickly once it exceeds the range, and the exponential asymptotic stability of the switched controller is proven as well. Both numerical and hardware-in-the-loop (HITL) simulations are conducted to verify the effectiveness and superiority of the proposed method compared with the existing method.

Perception-Aware Model Predictive Control for Target Tracking with UAVs

A Perception-Aware NMPC for Vision-Based Target Tracking and Collision Avoidance with a Multi-Rotor UAV

Perception-Aware Motion Control of Multiple Aerial Vehicle Transportation Systems

A Vision-based UAV Tracker Aiming at Aerial Targets

Integrated Path Planning and Trajectory Tracking Control for Quadrotor UAVs with Obstacle Avoidance in the Presence of Environmental and Systematic Uncertainties: Theory and Experiment

Central-distributed Control Model of UAV Group and its application in Perception Module

Perception-Aware Model Predictive Visual Servoing for Fixed-Wing Unmanned Aerial Vehicles in Target Tracking

Multi-UAVs Communication-Aware Cooperative Target Tracking

Uav Formation Flight Cooperative Tracking Controller Design

Finite-time Formation Tracking Control with Collision Avoidance for Quadrotor UAVs

Design and Information Architectures for an Unmanned Aerial Vehicle Cooperative Formation Tracking Controller.

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Model Predictive Formation Tracking-Containment Control for Multi-UAVs with Obstacle Avoidance

Dynamic Target Tracking of Small UAVs in Unstructured Environment

Robust Vision-Based Control of a Rotorcraft UAV for Uncooperative Target Tracking

Observation-Driven Multiple UAV Coordinated Standoff Target Tracking Based on Model Predictive Control

Research on UAV Dynamic Target Tracking with Multi-sensor Position Feedback.

PAMPC: Perception-Aware Model Predictive Control for Quadrotors

Online Predictive Visual Servo Control for Constrained Target Tracking of Fixed-Wing Unmanned Aerial Vehicles

Virtual Target Guidance-Based Distributed Model Predictive Control for Formation Control of Multiple UAVs

UAV Formation Control Under Communication Constraints Based on Distributed Model Predictive Control