Abstract:This paper proposes an online predictive control method for fixed-wing unmanned aerial vehicles (UAVs) with a pan-tilt camera in target tracking. It aims to achieve long-term tracking while concurrently maintaining the target near the image center. Particularly, this work takes the UAV and pan-tilt camera as an overall system and deals with the target tracking problem via joint optimization, so that the tracking ability of the UAV can be improved. The image captured by the pan-tilt camera is the unique input associated with the target, and model predictive control (MPC) is used to solve the optimization problem with constraints that cannot be performed by the classic image-based visual servoing (IBVS). In addition to the dynamic constraint of the UAV, the perception constraint of the camera is also taken into consideration, which is described by the maximum distance between the target and the camera. The accurate detection of the target depends on the amount of its feature information contained in the image, which is highly related to the relative distance between the target and the camera. Moreover, considering the real-time requirements of practical applications, an MPC strategy based on soft constraints and a warm start is presented. Furthermore, a switching-based approach is proposed to return the target back to the perception range quickly once it exceeds the range, and the exponential asymptotic stability of the switched controller is proven as well. Both numerical and hardware-in-the-loop (HITL) simulations are conducted to verify the effectiveness and superiority of the proposed method compared with the existing method.

Fast and Adaptive Ground Target Tracking for Fixed Wing-Uav Based on Visual Servo Control

A Vision-based UAV Tracker Aiming at Aerial Targets

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Image-Based Visual Servo Tracking Control of a Ground Moving Target for a Fixed-Wing Unmanned Aerial Vehicle

On trackability of a moving target by fixed-wing UAV using geometric approach

Vision-based UAV adaptive tracking control for moving targets with velocity observation

Online Predictive Visual Servo Control for Constrained Target Tracking of Fixed-Wing Unmanned Aerial Vehicles

A Vision-Based Ground Moving Target Tracking System for Quadrotor UAVs

Image-Based Visual Servoing of Quadrotors to Arbitrary Flight Targets

Visual servoing of quadrotor UAVs for slant targets with autonomous object search

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

Image-based finite-time visual servoing of a quadrotor for tracking a moving target

Robust Vision-Based Control of a Rotorcraft UAV for Uncooperative Target Tracking

Image-based Visual Servoing via Nonsingular Fast Terminal Adaptive Sliding Mode Control for a Quadrotor UAV Subjected to Wind Fields

IBVS Based on Adaptive Sliding Mode Control for a Quadrotor Target Tracking under Perturbations

Fixed-Time Differentiator-based Adaptive Nonsingular Fast Terminal Image-based Visual Servoing for a Quadrotor UAV Subject to Turbulent Wind

Robust Visual Servoing Control for Ground Target Tracking of Quadrotors

An image-based visual servoing control method for UAVs based on fuzzy logic

Image-Based Visual Tracking of a Moving Target for a Quadrotor

Robust Homography-based Visual Servo Control for a Quadrotor UAV Tracking a Moving Target