Abstract:This paper addresses the problem of visual target tracking in scenarios where a pursuer may experience intermittent loss of visibility of the target. The design of a Switched Visual Tracker (SVT) is presented which aims to meet the competing requirements of maintaining both proximity and visibility. SVT alternates between a visual tracking mode for following the target, and a recovery mode for regaining visual contact when the target falls out of sight. We establish the stability of SVT by extending the average dwell time theorem from switched systems theory, which may be of independent interest. Our implementation of SVT on an Agilicious drone [1] illustrates its effectiveness on tracking various target trajectories: it reduces the average tracking error by up to 45% and significantly improves visibility duration compared to a baseline algorithm. The results show that our approach effectively handles intermittent vision loss, offering enhanced robustness and adaptability for real-world autonomous missions. Additionally, we demonstrate how the stability analysis provides valuable guidance for selecting parameters, such as tracking speed and recovery distance, to optimize the SVT's performance.

What problem does this paper attempt to address?

This paper attempts to solve the problem in visual object tracking when the tracker (such as a drone) may experience intermittent blindness of the target. Specifically, the paper proposes the design of a **Switched Visual Tracker (SVT)**, aiming to meet the competing requirements of staying close to the target and maintaining visibility. SVT enters the visual tracking mode when the target is visible and enters the recovery mode when the target is out of sight to regain visual contact. ### Main problems 1. **Intermittent blindness problem**: When the target is temporarily invisible due to motion blur, occlusion, or being out of the tracker's field of view, traditional visual tracking methods cannot resume tracking the target. 2. **Conflict between maintaining visibility and closeness**: As the tracker approaches the target, the camera's field of view becomes narrower, leading to a contradiction between maintaining visibility and approaching the target. ### Solutions The paper proposes a **Switched Visual Tracker (SVT)**, whose design includes: - **Visual tracking mode**: When the target is visible, the tracker follows the target. - **Recovery mode**: When the target is out of sight, the tracker performs specific operations to regain visual contact. ### Stability analysis To ensure the effectiveness of SVT, the author extends the average dwell time theorem in the switching system theory and proves that even if the system is temporarily unstable in some modes, as long as the average dwell time in the stable mode is long enough, the system can still achieve asymptotic stability. ### Experimental verification The author implements SVT on the Agilicious drone and verifies its effectiveness through experiments. The experimental results show that, compared with the baseline algorithm, SVT: - Reduces the average tracking error by 45%. - Significantly increases the proportion of time when the target is visible. ### Summary The main contributions of this paper include: 1. Designing a Switched Visual Tracker (SVT) that can effectively handle the intermittent blindness of the target. 2. Providing a strict stability analysis based on the switching system stability theory, which provides guidance for parameter selection. 3. Implementing SVT on actual hardware and verifying its performance through experiments. Through these works, the paper demonstrates the robustness and adaptability of SVT in handling real - world autonomous tasks.

Visual Tracking with Intermittent Visibility: Switched Control Design and Implementation