Abstract:With the development of Internet and cloud computing, multimedia data, such as images and videos, has become one of the most common data types being processed. As the scale of multimedia data being still increasing, it is vitally important to efficiently extract useful information from such a huge amount of multimedia data. However, due to the complexity of the core algorithms, multimedia retrieval applications are not only data intensive but also computationally intensive. Therefore, it has been a major challenge to accelerate the processing speed of such applications to satisfy the real-time requirement. As Graphic Processing Unit (GPU) has entered the general-propose computing domain (GPGPU), it has become one of the most popular accelerators for the applications with real-time requirements. In this paper, we parallelize a widely-used image retrieval algorithm called SURF on GPGPU, which is the core algorithm for many video and image retrieval applications. We first analyze the parallelism within SURF to guarantee that there are sufficient tasks being mapped to the large-scale computation resources in GPGPU. We then exploit some inherent GPGPU characteristics, such as 2D memory, to further boost the performance. Finally, we provide some optimization to the cooperation between CPU and GPGPU, which is generally ignored in previous designs. Experimental results show that our parallelization and optimization achieve a throughput of 340.5 frames/s on a NVIDIA GTX295 GPGPU, which is 15X faster than the maximal optimized CPU version. Compared to CUDA SURF, a state-of-the-art parallelization of SURF on GPGPU, our system achieves a speedup by a factor of 2.3X.

SRI-SURF: A better SURF powered by scaled-RAM interpolator on FPGA

FPGA-based Efficient Implementation of SURF Algorithm

Implementation of High Performance Hardware Architecture of OpenSURF Algorithm on FPGA

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

Optimization of Speeded-Up Robust Feature Algorithm for Hardware Implementation

SURFEX: A 57fps 1080P resolution 220mW silicon implementation for simplified speeded-up robust feature with 65nm process

A Real-Time FPGA-based Architecture for OpenSURF

FPGA-Based Parallel Implementation of SURF Algorithm

A High Performance Parallel Computing Architecture For Robust Image Features

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

A GPU-based high-throughput image retrieval algorithm

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System

Distribution-aware FAST Feature Point Extraction and Matching Based on FPGA

Dsp-Based Parallel Implementation Of Speeded-Up Robust Features

Real-time full-frame digital image stabilization system by SURF

On-Board Detection and Matching of Feature Points

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Towards On-Board SAR Processing with FPGA Accelerators and a PCIe Interface

FPGA-Based Multi-core Reconfigurable System for SAR Imaging

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM