Abstract:Due to its advantages of low latency, low power consumption, and high flexibility, FPGA-based acceleration technology has been more and more widely studied and applied in the field of computer vision in recent years. An FPGA-based feature extraction and tracking accelerator for real-time visual odometry (VO) and visual simultaneous localization and mapping (V-SLAM) is proposed, which can realize the complete acceleration processing capability of the image front-end. For the first time, we implement a hardware solution that combines features from accelerated segment test (FAST) feature points with Gunnar Farneback (GF) dense optical flow to achieve better feature tracking performance and provide more flexible technical route selection. In order to solve the scale invariance and rotation invariance lacking problems of FAST features, an efficient pyramid module with a five-layer thumbnail structure was designed and implemented. The accelerator was implemented on a modern Xilinx Zynq FPGA. The evaluation results showed that the accelerator could achieve stable tracking of features of violently shaking images and were consistent with the results from MATLAB code running on PCs. Compared to PC CPUs, which require seconds of processing time, the processing latency was greatly reduced to the order of milliseconds, making GF dense optical flow an efficient and practical technical solution on the edge side.

Multi-scale FAST Feature Extraction Heterogeneous Design Based on FPGA.

High speed video signal acquisition and processing system based on FPGA technique

Distribution-aware FAST Feature Point Extraction and Matching Based on FPGA

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

A Hardware Accelerated Scale Invariant Feature Detector For Real-Time Visual Localization And Mapping

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

CNN-based Feature-point Extraction for Real-time Visual SLAM on Embedded FPGA

A High-Speed Feature Matching Method of High-Resolution Aerial Images.

FPGA-based Design of Real-time Video Processing Platform

Real-time Implementation of Sift Feature Extraction Algorithms in FPGA

High Definition Image Real-Time Mosaic Design Based on FPGA

Real-time Implementation of Harris Corner Detection System Based on FPGA

Hecto-Scale Frame Rate Face Detection System for SVGA Source on FPGA Board

On-Board Detection and Matching of Feature Points

Optimal Fpga Implementation Of High Speed Scale Space Generator

A Hardware Accelerator with Variable Pixel Representation & Skip Mode Prediction for Feature Point Detection Part of SIFT Algorithm.

Multi-channel high-speed CMOS image acquisition and pre-processing system

Design of High-speed Image Processing Platform Based on FPGA

A High Performance Parallel Computing Architecture For Robust Image Features

Face detection system for SVGA source with hecto-scale frame rate on FPGA board

FPGA-based Binocular Image Feature Extraction and Matching System