Abstract:The maintenance of visual features within the sensor field of view poses a significant challenge for underactuated aerial vehicles such as quadrotors, especially during aggressive maneuvers. However, the existing image-based visual servo (IBVS) control methods rely on strict target visibility assumptions or impose excessive constraints on the quadrotor's agility to meet this requirement. Furthermore, the effectiveness of the visibility constraint defined in prior works remains unverified in aggressive flight tests. To address these issues, we present a robust IBVS scheme for quadrotors to perform aggressive maneuvers while ensuring target visibility. Based on the nonlinear model-predictive control framework, we propose a novel underactuation compensation scheme to eliminate the need for a virtual camera frame, which enables us to formulate the true target visibility constraint. We then introduce a quaternion-based representation of spherical visual features to handle the nonsmooth vector field problem on the 2-sphere and derive its corresponding image kinematics. We validate our method through three challenging visual servo tasks where agile maneuvers are desired: fast landing, aggressive long-distance flight, and dynamic object tracking. Extensive simulation and experiment show that our method consistently achieves a target-visible rate of 100% in all the image frames, even under a maximum pitch of 21.04$^{circ }$. The results validate the effectiveness of our visibility constraint under large robot rotations and underscore its importance in enabling robust and aggressive flights.

Image-based finite-time visual servoing of a quadrotor for tracking a moving target

Image-Based Visual Tracking of a Moving Target for a Quadrotor

Image-Based Visual Servoing of Quadrotors to Arbitrary Flight Targets

Image-Based Visual Servoing of A Quadrotor Using Virtual Camera Approach

Fixed-time controller of visual quadrotor for tracking a moving target

Image based fixed time visual servoing control for the quadrotor UAV

Image-based Visual Servoing via Nonsingular Fast Terminal Adaptive Sliding Mode Control for a Quadrotor UAV Subjected to Wind Fields

Perception-Aware Image-Based Visual Servoing of Aggressive Quadrotor UAVs

Visual servoing of quadrotor UAVs for slant targets with autonomous object search

Visual Servo Control Of Unmanned Aerial Vehicles: An Object Tracking-Based Approach

Planning and Tracking in Image Space for Image-Based Visual Servoing of a Quadrotor.

Geometric Adaptive Dynamic Visual Servoing of a Quadrotor UAV.

Fixed-Time Differentiator-based Adaptive Nonsingular Fast Terminal Image-based Visual Servoing for a Quadrotor UAV Subject to Turbulent Wind

Robust Observer-Based Visual Servo Control for Quadrotors Tracking Unknown Moving Targets

Vision-based UAV adaptive tracking control for moving targets with velocity observation

Image-Based Visual Servoing of Rotorcrafts to Planar Visual Targets of Arbitrary Orientation

Image-Based Visual Servo Control of a Quadrotor under Field of View Constraints Using a Pan-Tilt Camera

Finite-time Control for Image-based Visual Servoing of a Quadrotor Using Nonsingular Fast Terminal Sliding Mode

Robust Homography-based Visual Servo Control for a Quadrotor UAV Tracking a Moving Target

Robust vision-based control of an underactuated flying robot tracking a moving target

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method