Abstract:With the development of Internet and cloud computing, multimedia data, such as images and videos, has become one of the most common data types being processed. As the scale of multimedia data being still increasing, it is vitally important to efficiently extract useful information from such a huge amount of multimedia data. However, due to the complexity of the core algorithms, multimedia retrieval applications are not only data intensive but also computationally intensive. Therefore, it has been a major challenge to accelerate the processing speed of such applications to satisfy the real-time requirement. As Graphic Processing Unit (GPU) has entered the general-propose computing domain (GPGPU), it has become one of the most popular accelerators for the applications with real-time requirements. In this paper, we parallelize a widely-used image retrieval algorithm called SURF on GPGPU, which is the core algorithm for many video and image retrieval applications. We first analyze the parallelism within SURF to guarantee that there are sufficient tasks being mapped to the large-scale computation resources in GPGPU. We then exploit some inherent GPGPU characteristics, such as 2D memory, to further boost the performance. Finally, we provide some optimization to the cooperation between CPU and GPGPU, which is generally ignored in previous designs. Experimental results show that our parallelization and optimization achieve a throughput of 340.5 frames/s on a NVIDIA GTX295 GPGPU, which is 15X faster than the maximal optimized CPU version. Compared to CUDA SURF, a state-of-the-art parallelization of SURF on GPGPU, our system achieves a speedup by a factor of 2.3X.

FPGA-based Efficient Implementation of SURF Algorithm

FPGA-Based Parallel Implementation of SURF Algorithm

Implementation of High Performance Hardware Architecture of OpenSURF Algorithm on FPGA

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

Optimization of Speeded-Up Robust Feature Algorithm for Hardware Implementation

SRI-SURF: A better SURF powered by scaled-RAM interpolator on FPGA

SURFEX: A 57fps 1080P resolution 220mW silicon implementation for simplified speeded-up robust feature with 65nm process

A High Performance Parallel Computing Architecture For Robust Image Features

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Research of high speed image processing system based on FPGA

On-Board Detection and Matching of Feature Points

A GPU-based high-throughput image retrieval algorithm

Dsp-Based Parallel Implementation Of Speeded-Up Robust Features

Parallel and Pipelining design of SLAM Feature Detection Algorithm in Hardware

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

FPGA-based Binocular Image Feature Extraction and Matching System

Resolving Implementation Ambiguity and Improving SURF

FPGA implementation of full HD real-time depth estimation

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System