Abstract:Active vision systems (AVSs) have been widely used to obtain high-resolution images of objects of interest. However, tracking small objects in high-magnification scenes is challenging due to shallow depth of field (DoF) and narrow field of view (FoV). To address this, we introduce a novel high-speed AVS with a continuous autofocus (C-AF) approach based on dynamic-range focal sweep and a high-frame-rate (HFR) frame-by-frame tracking pipeline. Our AVS leverages an ultra-fast pan-tilt mechanism based on a Galvano mirror, enabling high-frequency view direction adjustment. Specifically, the proposed C-AF approach uses a 500 fps high-speed camera and a focus-tunable liquid lens operating at a sine wave, providing a 50 Hz focal sweep around the object's optimal focus. During each focal sweep, 10 images with varying focuses are captured, and the one with the highest focus value is selected, resulting in a stable output of well-focused images at 50 fps. Simultaneously, the object's depth is measured using the depth-from-focus (DFF) technique, allowing dynamic adjustment of the focal sweep range. Importantly, because the remaining images are only slightly less focused, all 500 fps images can be utilized for object tracking. The proposed tracking pipeline combines deep-learning-based object detection, K-means color clustering, and HFR tracking based on color filtering, achieving 500 fps frame-by-frame tracking. Experimental results demonstrate the effectiveness of the proposed C-AF approach and the advanced capabilities of the high-speed AVS for magnified object tracking.

Motion-Blur-Free High-Speed Video Shooting Using a Resonant Mirror

Motion Blur Suppression Method Based on Dual Mode Imaging for Remote Sensing Image

Real-time high-speed motion blur compensation system based on back-and-forth motion control of galvanometer mirror

Ccd High Speed Videography System With New Concepts And Techniques

Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Method To Detect And Calculate Motion Blur Kernel

Some Applications of Ccd Rapid-Changing-Frequency High Speed Videography System

Driving Techniques for High Frame Rate Ccd Camera

Motion Blurred Image Restoration Based on Hartmann-Shack Wavefront Sensor

Restoration of the Image Blurred by Motion Based on High-speed CCD Motion Detection

High-Magnification Object Tracking with Ultra-Fast View Adjustment and Continuous Autofocus Based on Dynamic-Range Focal Sweep

Monocular Stereo Measurement Using High-Speed Catadioptric Tracking

Single-pixel imaging of a translational object

Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection

Fast Blur Removal Via Optical Computing

Single-pixel Imaging of a Translational Object.

A New Type of Control System for A Continuous Access Rotating-Mirror High Speed Camera

Performance Capture of High-Speed Motion Using Staggered Multi-View Recording

Virtual Frame Technique: Ultrafast Imaging with Any Camera

A High-Speed Vision-Based Sensor for Dynamic Vibration Analysis Using Fast Motion Extraction Algorithms.

Bringing a Blurry Frame Alive at High Frame-Rate With an Event Camera