Risley-prism-based tracking model for fast locating a target using imaging feedback

Anhu Li,Zusheng Zhao,Xingsheng Liu,Zhaojun Deng

DOI: https://doi.org/10.1364/OE.384694

IF: 3.8

2020-02-13

Optics Express

Abstract:Anhu Li, Zusheng Zhao, Xingsheng Liu, Zhaojun Deng Fast imaging tracking technology exhibits attractive application prospects in the emerging fields of target tracking and recognition. Smart ... [Opt. Express 28, 5378-5392 (2020)]

optics

What problem does this paper attempt to address?

A Single-Camera Gaze Tracking System under Natural Light

Feng Xiao,Dandan Zheng,Kejie Huang,Yue Qiu,Haibin Shen

DOI: https://doi.org/10.16910/jemr.11.4.5

IF: 1.3489

2018-01-01

Journal of Eye Movement Research

Abstract:Gaze tracking is a human-computer interaction technology, and it has been widely studied in the academic and industrial fields. However, constrained by the performance of the specific sensors and algorithms, it has not been popularized for everyone. This paper proposes a single-camera gaze tracking system under natural light to enable its versatility. The iris center and anchor point are the most crucial factors for the accuracy of the system. The accurate iris center is detected by the simple active contour snakuscule, which is initialized by the prior knowledge of eye anatomical dimensions. After that, a novel anchor point is computed by the stable facial landmarks. Next, second-order mapping functions use the eye vectors and the head pose to estimate the points of regard. Finally, the gaze errors are improved by implementing a weight coefficient on the points of regard of the left and right eyes. The feature position of the iris center achieves an accuracy of 98.87% on the GI4E database when the normalized error is lower than 0.05. The accuracy of the gaze tracking method is superior to the-state-of-the-art appearance-based and feature-based methods on the EYEDIAP database.
Fast and high-precision tracking technology for image-based closed-loop cascaded control system with a Risley prism and fast steering mirror

Xia Huayang,yunxia Xia,Liangzhu Yuan,Piao Wen,Wenxue Zhang,Ke Ding,Fan Yue,Haotong Ma,Jinying Li,Huayang Xia,Yunxia Xia,Yue Fan

DOI: https://doi.org/10.1364/oe.511987

IF: 3.8

2024-02-28

Optics Express

Abstract:Huayang Xia, Yunxia Xia, Liangzhu Yuan, Piao Wen, Wenxue Zhang, Ke Ding, Yue Fan, Haotong Ma, Jinying Li The Risley prism's compact structure, dynamic responsiveness, and high tracking accuracy make it ideal for photoelectric image tracking. To ... [Opt. Express 32, 8555-8571 (2024)]

optics
Fast and Sub-Pixel Precision Target Tracking Algorithm for Intelligent Dual-Resolution Camera.

Zhuang He,Qi Li,Huajun Feng,Zhihai Xu

DOI: https://doi.org/10.1007/s00371-019-01724-4

IF: 2.835

2019-01-01

The Visual Computer

Abstract:The intelligent dual-resolution camera can provide large imaging field and high-resolution for the parts in which we are interested simultaneously. It has important applications in visual tracking. Though many trackers show great robustness on recent benchmarks, few of them make high precision and run in real-time, which is harmful to practical applications. In this paper, we propose a fast and sub-pixel precision tracker. It uses the time-shift property of Fourier transform to convert the displacement of target in space domain into the period of the response in Fourier domain. Then an improved Hough transform is introduced to measure this period, so that the displacement with sub-pixel precision can be calculated. Furthermore, a method obtaining benchmarks utilizing the intelligent dual-resolution camera is proposed to verify the high-precision of our tracker. Many experiments have been done to compare the proposed tracker with some state-of-the-art sub-pixel precision trackers, and the results have shown that the proposed tracker outperform the best tracker by 15.4% in average median distance precision, while feasible for real-time tracking with the speed faster than 80 fps. What’s more, the proposed tracker have been evaluated on the dual-resolution camera, the results show that it can make the observation of targets in the high-resolution image more complete.
Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Neng Pan,Ruibin Zhang,Tiankai Yang,Can Cui,Chao Xu,Fei Gao

DOI: https://doi.org/10.1049/csy2.12033

2021-01-01

IET Cyber-Systems and Robotics

Abstract:In recent years, several progressive works promote the development of aerial tracking. One of the representative works is our previous work Fast-tracker which is applicable to various challenging tracking scenarios. However, it suffers from two main drawbacks: 1) the over simplification in target detection by using artificial markers and 2) the contradiction between simultaneous target and environment perception with limited onboard vision. In this paper, we upgrade the target detection in Fast-tracker to detect and localize a human target based on deep learning and non-linear regression to solve the former problem. For the latter one, we equip the quadrotor system with 360 degree active vision on a customized gimbal camera. Furthermore, we improve the tracking trajectory planning in Fast-tracker by incorporating an occlusion-aware mechanism that generates observable tracking trajectories. Comprehensive real-world tests confirm the proposed system's robustness and real-time capability. Benchmark comparisons with Fast-tracker validate that the proposed system presents better tracking performance even when performing more difficult tracking tasks.
High-speed target tracking control system based on short-time rotational reflection imaging

Haoran Liu,Jiehu Kang,Luyuan Feng,Jianwei Zhang,Fei Fan,Zhen Zhang,Zefeng Sun,Bin Wu

DOI: https://doi.org/10.1364/ao.514800

IF: 1.9

2024-01-26

Applied Optics

Abstract:Haoran Liu, Jiehu Kang, Luyuan Feng, Jianwei Zhang, Fei Fan, Zhen Zhang, Zefeng Sun, Bin Wu High-speed tracking technology has wide applications in the military and aerospace industry. However, existing approaches, such as camera ... [Appl. Opt. 63, 1094-1104 (2024)]

optics
Mask-based single-pixel tracking and imaging for moving objects

Yu Zhang,Hongjie Wang,Yongkai Yin,Wenjie Jiang,Baoqing Sun

DOI: https://doi.org/10.1364/oe.501531

IF: 3.8

2023-09-15

Optics Express

Abstract:Yu Zhang, Hongjie Wang, Yongkai Yin, Wenjie Jiang, Baoqing Sun Tracking and imaging for high-speed moving objects have a wide range of application prospects in many fields, such as transportation and ... [Opt. Express 31, 32554-32564 (2023)]

optics
Risley-prism-based visual tracing method for robot guidance

Anhu Li,Qiao Li,Zhaojun Deng,Yang Zhang

DOI: https://doi.org/10.1364/JOSAA.381445

2020-04-01

Abstract:A visual tracing model based on Risley prisms is proposed in this paper. Combined with the boresight adjusting technology and the visual detection technology, a new visual system is established. Placing Risley prisms in front of the camera, the field of view of the camera can be dynamically adjusted so that the imageable area of this camera is expanded greatly. Two real-time visual tracing strategies for dynamic targets are proposed, which effectively avoid the problems of target loss and tracking instability. The deviations between the reference trajectory generated by the manipulator and the actual trajectory detected by our visual system are measured. Experimental results show that the deviations are less than 1.5% in the 250 mm motion space of the manipulator. It is verified that the visual system can be used to guide robots with high precision, which provides a potential method for robot navigation.
Adaptive milliseconds tracking and zooming optics based on a high-speed gaze controller and liquid lenses

Jiaqi Li,Lin Li,Lihui Wang,Lei Li,Shaoyong Li,Masatoshi Ishikawa

DOI: https://doi.org/10.1364/oe.512003

IF: 3.8

2024-01-09

Optics Express

Abstract:Jiaqi Li, Lin Li, Lihui Wang, Lei Li, Shaoyong Li, Masatoshi Ishikawa The high-speed gaze and high resolution are critical factors for actual monitoring systems. However, the conventional method cannot track ... [Opt. Express 32, 2257-2270 (2024)]

optics
Kinematic target surface sensing based on improved deep optical flow tracking

Lei Lu,Hao Liu,Hongliang Fu,Zhilong Su,Wei Pan,Qinghui Zhang,Jinhui Wang

DOI: https://doi.org/10.1364/oe.505993

IF: 3.8

2023-11-03

Optics Express

Abstract:Lei Lu, Hao Liu, Hongliang Fu, Zhilong Su, Wei Pan, Qinghui Zhang, Jinhui Wang Reconstruction of moving target surfaces based on active image sensing techniques, such as phase-shifting profilometry, has attracted ... [Opt. Express 31, 39007-39019 (2023)]

optics
Advancement on target ranging and tracking by single-point photon counting lidar

Zhikang Li,Bo Liu,Huachuang Wang,Hao Yi,Zhen Chen

DOI: https://doi.org/10.1364/OE.464070

IF: 3.8

2022-08-02

Optics Express

Abstract:Zhikang Li, Bo Liu, Huachuang Wang, Hao Yi, Zhen Chen Laser tracking with a cooperative target has been widely used in many fields and becomes increasingly important while the non-cooperative ... [Opt. Express 30, 29907-29922 (2022)]

optics
Scale-adaptive three-dimensional imaging using Risley-prism-based coherent lidar

Xingsheng Liu,Anhu Li,Hao Chen,Jianfeng Sun,Zhiyong Lu

DOI: https://doi.org/10.1364/OL.487477

IF: 3.6

2023-05-06

Optics Letters

Abstract:Xingsheng Liu, Anhu Li, Hao Chen, Jianfeng Sun, Zhiyong Lu We present a scale-adaptive three-dimensional (3D) imaging architecture for coherent light detection and ranging (lidar) that incorporates ... [Opt. Lett. 48, 2587-2590 (2023)]

optics
Analysis on key issues of boresight adjustment in imaging tracking based on Risley prisms

Yuan Zhou,Ying Chen,Liping Sun,Fangrong Hu,Zhiyou Wang,Shixun Fan

DOI: https://doi.org/10.1117/1.oe.59.12.123104

IF: 1.3

2020-12-14

Optical Engineering

Abstract:Risley prisms can serve as a beam steering device to move field of view and appear to be a promising solution to boresight adjustment in imaging tracking applications. It is desirable to deduce the inherent relation among target offsets, target’s line of sight (LOS) deviations from sensor’s boresight and the required prism rotations. The boresight adjustment model based on Risley prisms is described. Reverse ray tracing is performed and case examples are given to characterize the nonlinear relationship between target offset and its LOS deviation. A boresight adjustment method based on the inverse ray tracing and the two-step method is then illustrated. The simulation results show that the target’s LOS deviations from the boresight are stretched along the boresight’s radial direction relative to the target offsets. By the proposed boresight adjustment method, the required rotations of the prisms can be derived from the target offset. The singularity problem is also pointed out using this method, and the corresponding conclusions are consistent with those deduced in many works. The research demonstrates the inner mechanisms of the imaging tracking based on Risley prisms in principle. The proposed boresight adjustment method can provide guidance for controlling the circular motion of the prisms.

optics
Tracking and fast imaging of a moving object via Fourier modulation

Shijian Li,Xu-Ri Yao,Wei Zhang,Yeliang Wang,Qing Zhao

DOI: https://doi.org/10.1103/physrevapplied.22.044007

IF: 4.6

2024-10-04

Physical Review Applied

Abstract:Recently, several single-pixel-imaging schemes have emerged for imaging fast-moving objects and have shown dramatic results. However, fast image reconstruction of a moving object with high quality is still challenging for single-pixel imaging, thereby limiting its practical application. In this pape... [Phys. Rev. Applied 22, 044007] Published Thu Oct 03, 2024

physics, applied
SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging

Ziyang Chen,Mustafa Doğa Doğan,Josef Spjut,Kaan Akşit

DOI: https://doi.org/10.1145/3681756.3697875

2024-10-08

Abstract:Precision pose detection is increasingly demanded in fields such as personal fabrication, Virtual Reality (VR), and robotics due to its critical role in ensuring accurate positioning information. However, conventional vision-based systems used in these systems often struggle with achieving high precision and accuracy, particularly when dealing with complex environments or fast-moving objects. To address these limitations, we investigate Laser Speckle Imaging (LSI), an emerging optical tracking method that offers promising potential for improving pose estimation accuracy. Specifically, our proposed LSI-Based Tracking (SpecTrack) leverages the captures from a lensless camera and a retro-reflector marker with a coded aperture to achieve multi-axis rotational pose estimation with high precision. Our extensive trials using our in-house built testbed have shown that SpecTrack achieves an accuracy of 0.31° (std=0.43°), significantly outperforming state-of-the-art approaches and improving accuracy up to 200%.

Emerging Technologies,Computer Vision and Pattern Recognition
Prior-free 3D tracking of a fast-moving object at 6667 frames per second with single-pixel detectors

Huan Zhang,Zonghao Liu,Mi Zhou,Zibang Zhang,Mu Ku Chen,Zihan Geng

DOI: https://doi.org/10.1364/ol.521176

IF: 3.6

2024-06-21

Optics Letters

Abstract:Huan Zhang, Zonghao Liu, Mi Zhou, Zibang Zhang, Muku Chen, Zihan Geng Real-time tracking and 3D trajectory computation of fast-moving objects is a promising technology, especially in the field of autonomous ... [Opt. Lett. 49, 3628-3631 (2024)]

optics
Double-wedge prism imaging tracking device based on the adaptive boresight adjustment principle

Anhu Li,Shengze Zhong,Xingsheng Liu,Yang Zhang

DOI: https://doi.org/10.1063/1.5078700

IF: 1.6

2019-02-01

Review of Scientific Instruments

Abstract:A double-wedge prism device has been used in various imaging detection applications due to its high precision and strong anti-disturbance capability. In this paper, a self-adaptation double-wedge prism boresight adjustment principle suitable for both far-field and near-field target tracking is proposed. In order to realize this application, an adaptive variable boresight imaging tracking device is designed specifically. Then a tracking error model is established, and dynamic simulation, error evaluation, and sensitivity analysis are carried out according to the design objective. The experimental results show that the pitch angle deviation and azimuth angle deviation of the device are less than 6', and the blind zone can be eliminated by adding a third wedge prism, thus achieving high-precision boresight adjustment and tracking.

instruments & instrumentation,physics, applied
Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Anhu Li,Xingsheng Liu,Jianfeng Sun,Zhiyong Lu

DOI: https://doi.org/10.1016/j.optlaseng.2021.106836

IF: 5.666

2022-03-01

Optics and Lasers in Engineering

Abstract:Light detection and ranging (LiDAR) as a significant approach to three-dimensional perception has increasingly suffered from challenges for compact structure, high resolution and strong adaptability. This paper presents a versatile LiDAR system that incorporates multi-beam scanning using Risley prisms and coherent detection based on triangular frequency modulation. By combining Risley-prism-based multi-beam steering model with simultaneous distance and velocity measurements, the LiDAR architecture for three-dimensional imaging is theoretically demonstrated. A unified LiDAR point cloud processing framework is developed, where the multi-mode integrated filtering method is proposed for outlier removal using point cloud characteristics. The coarse-fine coupled strategy is also formulated to combine statistical modeling with iterative optimization for multi-channel point cloud registration. It is experimentally validated that our LiDAR can achieve high-resolution three-dimensional information acquisition against long range, and the proposed point cloud processing technique can fully reconstruct the spatial form of object while preserving sufficient details.

optics
Efficient non-line-of-sight tracking with computational neuromorphic imaging

Shuo Zhu,Zhou Ge,Chutian Wang,Jing Han,Edmund Y. Lam

DOI: https://doi.org/10.1364/ol.530066

IF: 3.6

2024-06-19

Optics Letters

Abstract:Shuo Zhu, Zhou Ge, Chutian Wang, Jing Han, Edmund Y. Lam Non-line-of-sight (NLOS) sensing is an emerging technique that is capable of detecting objects hidden behind a wall, around corners, or ... [Opt. Lett. 49, 3584-3587 (2024)]

optics
Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection

Qiwen Deng,Zibang Zhang,Jingang Zhong

DOI: https://doi.org/10.1364/OL.399204

2020-09-01

Abstract:Real-time 3-D tracking of a fast-moving object has found important applications in industry, traffic control, sports, biomedicine, defense, etc. However, it is difficult to adopt typical image-based object tracking systems in a fast-moving object tracking in real time and for a long duration, because reliable and robust image processing and analysis algorithms are often computationally exhausted, and limited storage and bandwidth can hardly fulfill the great demand of high-speed photography. Here we report an image-free 3-D tracking approach. The approach uses only two single-pixel detectors and a high-speed spatial light modulator for data acquisition. By illuminating the target moving object with six single-period Fourier basis patterns, the approach is able to analytically calculate the position of the object with the corresponding single-pixel measurements. The approach is low-cost, and data- and computation-efficient. We experimentally demonstrate that the proposed approach can detect and track a fast-moving object at a frame rate of 1666 frames per second by using a 10,000 Hz digital micromirror device. Benefiting from the wide working spectrum of single-pixel detectors, the reported approach might be applicable for hidden fast-moving object tracking.

Risley-prism-based tracking model for fast locating a target using imaging feedback

A Single-Camera Gaze Tracking System under Natural Light

Fast and high-precision tracking technology for image-based closed-loop cascaded control system with a Risley prism and fast steering mirror

Fast and Sub-Pixel Precision Target Tracking Algorithm for Intelligent Dual-Resolution Camera.

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

High-speed target tracking control system based on short-time rotational reflection imaging

Mask-based single-pixel tracking and imaging for moving objects

Risley-prism-based visual tracing method for robot guidance

Adaptive milliseconds tracking and zooming optics based on a high-speed gaze controller and liquid lenses

Kinematic target surface sensing based on improved deep optical flow tracking

Advancement on target ranging and tracking by single-point photon counting lidar

Scale-adaptive three-dimensional imaging using Risley-prism-based coherent lidar

Analysis on key issues of boresight adjustment in imaging tracking based on Risley prisms

Tracking and fast imaging of a moving object via Fourier modulation

SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging

Prior-free 3D tracking of a fast-moving object at 6667 frames per second with single-pixel detectors

Double-wedge prism imaging tracking device based on the adaptive boresight adjustment principle

Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Efficient non-line-of-sight tracking with computational neuromorphic imaging

Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection