Abstract:With the development of Internet and cloud computing, multimedia data, such as images and videos, has become one of the most common data types being processed. As the scale of multimedia data being still increasing, it is vitally important to efficiently extract useful information from such a huge amount of multimedia data. However, due to the complexity of the core algorithms, multimedia retrieval applications are not only data intensive but also computationally intensive. Therefore, it has been a major challenge to accelerate the processing speed of such applications to satisfy the real-time requirement. As Graphic Processing Unit (GPU) has entered the general-propose computing domain (GPGPU), it has become one of the most popular accelerators for the applications with real-time requirements. In this paper, we parallelize a widely-used image retrieval algorithm called SURF on GPGPU, which is the core algorithm for many video and image retrieval applications. We first analyze the parallelism within SURF to guarantee that there are sufficient tasks being mapped to the large-scale computation resources in GPGPU. We then exploit some inherent GPGPU characteristics, such as 2D memory, to further boost the performance. Finally, we provide some optimization to the cooperation between CPU and GPGPU, which is generally ignored in previous designs. Experimental results show that our parallelization and optimization achieve a throughput of 340.5 frames/s on a NVIDIA GTX295 GPGPU, which is 15X faster than the maximal optimized CPU version. Compared to CUDA SURF, a state-of-the-art parallelization of SURF on GPGPU, our system achieves a speedup by a factor of 2.3X.

Implementation of High Performance Hardware Architecture of OpenSURF Algorithm on FPGA

FPGA-based Efficient Implementation of SURF Algorithm

A Real-Time FPGA-based Architecture for OpenSURF

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

FPGA-Based Parallel Implementation of SURF Algorithm

SRI-SURF: A better SURF powered by scaled-RAM interpolator on FPGA

Optimization of Speeded-Up Robust Feature Algorithm for Hardware Implementation

A High Performance Parallel Computing Architecture For Robust Image Features

Research of high speed image processing system based on FPGA

SURFEX: A 57fps 1080P resolution 220mW silicon implementation for simplified speeded-up robust feature with 65nm process

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

On-Board Detection and Matching of Feature Points

Parallel and Pipelining design of SLAM Feature Detection Algorithm in Hardware

Parallel implementation of surf algorithm based on OpenCL

Distribution-aware FAST Feature Point Extraction and Matching Based on FPGA

A GPU-based high-throughput image retrieval algorithm

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

Study and Implementation of High-speed Real-time Image Processing Technique Based on SOPC

Dsp-Based Parallel Implementation Of Speeded-Up Robust Features

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga

High-performance Heterogeneous FPGA Data-Flow Architecture for Fourier Ptychographic Microscopy.