Abstract:Active vision systems (AVSs) have been widely used to obtain high-resolution images of objects of interest. However, tracking small objects in high-magnification scenes is challenging due to shallow depth of field (DoF) and narrow field of view (FoV). To address this, we introduce a novel high-speed AVS with a continuous autofocus (C-AF) approach based on dynamic-range focal sweep and a high-frame-rate (HFR) frame-by-frame tracking pipeline. Our AVS leverages an ultra-fast pan-tilt mechanism based on a Galvano mirror, enabling high-frequency view direction adjustment. Specifically, the proposed C-AF approach uses a 500 fps high-speed camera and a focus-tunable liquid lens operating at a sine wave, providing a 50 Hz focal sweep around the object's optimal focus. During each focal sweep, 10 images with varying focuses are captured, and the one with the highest focus value is selected, resulting in a stable output of well-focused images at 50 fps. Simultaneously, the object's depth is measured using the depth-from-focus (DFF) technique, allowing dynamic adjustment of the focal sweep range. Importantly, because the remaining images are only slightly less focused, all 500 fps images can be utilized for object tracking. The proposed tracking pipeline combines deep-learning-based object detection, K-means color clustering, and HFR tracking based on color filtering, achieving 500 fps frame-by-frame tracking. Experimental results demonstrate the effectiveness of the proposed C-AF approach and the advanced capabilities of the high-speed AVS for magnified object tracking.

Real-time object tracking based on scale-invariant features employing bio-inspired hardware

Fast and Sub-Pixel Precision Target Tracking Algorithm for Intelligent Dual-Resolution Camera.

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Infrared Small Target Tracking Based on Sopc

Real-time vision system for a Ping-Pong robot

GPU-based Parallel Optimization for Real-Time Scale-Invariant Feature Transform in Binocular Visual Registration.

A Fast and Energy Efficient FPGA-based System for Real-Time Object Tracking

Robust Visual Tracking Based on Scale Invariance and Deep Learning

Real-time Tracking Based on Neuromrophic Vision

A Hardware Accelerator with Variable Pixel Representation & Skip Mode Prediction for Feature Point Detection Part of SIFT Algorithm.

A FPGA Based High-Speed Binocular Active Vision System for Tracking Circle-Shaped Target

Recognizing Ultra-High-Speed Moving Objects with Bio-Inspired Spike Camera

FPGA-based Acceleration System for Visual Tracking

A 83fps 1080P Resolution 354 Mw Silicon Implementation for Computing the Improved Robust Feature in Affine Space

High-Magnification Object Tracking with Ultra-Fast View Adjustment and Continuous Autofocus Based on Dynamic-Range Focal Sweep

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

An Active Multi-Object Ultrafast Tracking System with CNN-Based Hybrid Object Detection

High-Speed Tracking with Mutual Assistance of Feature Filters and Detectors

ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm

Real-time Motion Detection with High-speed Vision and Local Parallel Processing

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System