Abstract:Visual feature detection has been widely used in many computer vision applications, with increasing concern on feature robustness, processing speed, and power efficiency. In comparison with popular feature detection algorithms, affine-SIFT achieves the strongest robustness on the image illumination, image rotation, and image scale transformation, but exhibits extreme high computation complexity. To improve its computing efficiency, this work first proposes three hardware optimization methods to address three main performance bottlenecks. The first method is the reverse affine-based pipelined computing with optimized memory accessing. The second method is about stream processing with full parallel Gaussian pyramid. The third method is the rotation invariant binary pattern based feature vector generation. Then by incorporating these three optimization methods, this paper designs a high-efficient pipelined and parallel hardware architecture with optimized parallel memory accessing. Postlayout simulations using TSMC 65-nm 1P9M low power process show that this work achieves a processing speed of 97 fps at 1080p (1000 feature points per frame on average) under 200 MHz, with power consumption at 300 mW. In comparison, its computing efficiency (1005.6K pixels/s at 1 MHz) and power efficiency (670.5K pixels/s at 1 mW) are higher than state-of-the-art works and it is more promising for broad vision applications especially the embedded vision and mobile vision applications.

An architecture of optimised SIFT feature detection for an FPGA implementation of an image matcher

A Fpga-Based Architecture for Real-Time Image Matching

An Embedded System-on-Chip Architecture for Real-time Visual Detection and Matching

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

A real-time embedded architecture for SIFT

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

Real-time Implementation of Sift Feature Extraction Algorithms in FPGA

A Hardware Accelerator with Variable Pixel Representation & Skip Mode Prediction for Feature Point Detection Part of SIFT Algorithm.

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

A Hardware Accelerated Scale Invariant Feature Detector For Real-Time Visual Localization And Mapping

An Optimized Structure on FPGA of Key Point Description in SIFT Algorithm

An Efficient Hardware Architecture of the Optimised SIFT Descriptor Generation.

A High-Speed Feature Matching Method of High-Resolution Aerial Images.

Distribution-aware FAST Feature Point Extraction and Matching Based on FPGA

An Optimized Structure on FPGA of Key Point Detection in SIFT Algorithm

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System

Optimization of SIFT algorithm for fast-image feature extraction in line-scanning ophthalmoscope

On-Board Detection and Matching of Feature Points

FPGA-based Efficient Implementation of SURF Algorithm

FPGA Implementation for Fast Infrared Spots Detection

ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm