Abstract:The maintenance of visual features within the sensor field of view poses a significant challenge for underactuated aerial vehicles such as quadrotors, especially during aggressive maneuvers. However, the existing image-based visual servo (IBVS) control methods rely on strict target visibility assumptions or impose excessive constraints on the quadrotor's agility to meet this requirement. Furthermore, the effectiveness of the visibility constraint defined in prior works remains unverified in aggressive flight tests. To address these issues, we present a robust IBVS scheme for quadrotors to perform aggressive maneuvers while ensuring target visibility. Based on the nonlinear model-predictive control framework, we propose a novel underactuation compensation scheme to eliminate the need for a virtual camera frame, which enables us to formulate the true target visibility constraint. We then introduce a quaternion-based representation of spherical visual features to handle the nonsmooth vector field problem on the 2-sphere and derive its corresponding image kinematics. We validate our method through three challenging visual servo tasks where agile maneuvers are desired: fast landing, aggressive long-distance flight, and dynamic object tracking. Extensive simulation and experiment show that our method consistently achieves a target-visible rate of 100% in all the image frames, even under a maximum pitch of 21.04$^{circ }$. The results validate the effectiveness of our visibility constraint under large robot rotations and underscore its importance in enabling robust and aggressive flights.

Sampling-Based Path Planning And Model Predictive Image-Based Visual Servoing For Quadrotor Uavs

3D Path Planning of Quadrotor Aerial Robots Using Numerical Optimization

Efficient Sampling-based Multirotors Kinodynamic Planning with Fast Regional Optimization and Post Refining

Integrating Fast Regional Optimization into Sampling-based Kinodynamic Planning for Multirotor Flight

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Perception-Aware Image-Based Visual Servoing of Aggressive Quadrotor UAVs

A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs

Visual servoing of quadrotor UAVs for slant targets with autonomous object search

Image-Based Visual Servoing of Quadrotors to Arbitrary Flight Targets

Real-time Motion Planning and Trajectory Tracking in Complex Environments Based on Bézier Curves and Nonlinear MPC Controller

Image based fixed time visual servoing control for the quadrotor UAV

Image-based finite-time visual servoing of a quadrotor for tracking a moving target

A Vision-based UAV Tracker Aiming at Aerial Targets

Model Predictive Spherical Image-Based Visual Servoing On $SO(3)$ for Aggressive Aerial Tracking

RMPC-Based Visual Servoing for Trajectory Tracking of Quadrotor UAVs with Visibility Constraints

Vision-based minimum-time trajectory generation for a quadrotor UAV

Path Planning and Control of a Quadrotor UAV Based on an Improved APF Using Parallel Search

Image-Based Visual Servoing of Rotorcrafts to Planar Visual Targets of Arbitrary Orientation

Global Path Planning of Quadrotor Using Reinforcement Learning

Vision-based adaptive prediction, planning, and execution of permissible and smooth trajectories for a 2DOF model helicopter

An image-based visual servoing control method for UAVs based on fuzzy logic