ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm
Zichen Fan,Zheyu Liu,Zheng Qu,Fei Qiao,Qi Wei,Xinjun Liu,Yinan Sun,Shuzheng Xu,Huazhong Yang
DOI: https://doi.org/10.1109/tvlsi.2019.2936818
2020-01-01
IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Abstract:The scale-invariant feature transform (SIFT) algorithm is still one of the most reliable image feature extraction methods. Despite its excellent robustness on various image transformations, SIFT's intensive computational burden has been severely preventing it from being used in real-time and energy-efficient embedded machine vision systems. To reduce processing time and energy cost while executing SIFT, an analog signal processing architecture, analog signal processing (ASP)-SIFT, is proposed in this article. In ASP-SIFT, the Gaussian pyramid construction, difference-of-Gaussian (DoG) pyramid construction and keypoint locating, which are the primary steps of the keypoint detection part of the SIFT algorithm, are done directly with analog circuit networks. Thus, by completing keypoint detection in the analog domain, the total processing time is approximately equal to the settling time of the circuit network. Besides, by adopting a current-mode circuit network operating in the subthreshold region, the power dissipation would be very low. Simulation results show that the total processing speed for a typical video graphics array (VGA)-format ( $640\times480$ ) image is up to 2.3 kframes per second, which is at least $3.26\times $ faster than the state-of-the-art digital hardware accelerators, while the system power is 94.5 mW and the energy consumption is only $40 similar to\mu \text{J}$ per frame.