Abstract:Optical flow algorithm, which estimates the motion detection of consequent video frames, is widely used in surveillance system, Advanced Driver Assistance Systems (ADAS) and object movement estimation in scene analysis. Among different optical flow algorithms, Farneback version provides a better accuracy and brightness-change-resistant displacements by estimating the flow from polynomial domain rather than intensive maps. However, high computation complexity and inconsistent data access patterns make it difficult to be implemented on a hardware platform. In this work, we present a micro-architecture design of Farneback optical flow, which is flexible for optimization with high level Synthesis (HLS) tools. The original software-based implementation was decomposed into functional blocks to balance latency of different stages and flows of data were rearranged to accommodate better memory access patterns. The data flow arrangement is based on a proposed backtrace mechanism, where DRAM accesses of polynomial coefficients in current frame makes consistent traffic patterns, and therefore make it possible to integrate more functional blocks into a deeper pipeline. For several micro-architecture design versions, we demonstrate options of fixed and floating points, optimization techniques such as multiple DMAs and different levels of pipeline integration. We implemented our design on Zedboard Mini-ITX 7045. The results show a 17x end-to-end speedup against a naive HLS version with an image size of 160x120. Considering only the hardware-accelerated part, our FPGA implementation is 40x faster than the naive HLS version with only 50% of the FPGA hardware resources.

Implementation of Graphics Accelerator of Line Raster Based on Bresenham Algorithm

A Hardware Algorithm for Graphics Rasterizer

An Efficient Algorithm To Generate A Line

An Improved Midpoint Rasterization Algorithm Implemented in FPGA

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Tile-based Multiple Parallel Triangle Rasterization Algorithm Implemented in FPGA

Design and Implementation of Rasterization Parallel Algorithm Based on Boundary Algebra Filling

An Improved Line - Drawing Algorithm for Arbitrary Fractional Frequency Divider / Multiplier Based on FPGA

Design and Implementation of Pixel Processing Back-End for 3D Graphics Pipeline

An FPGA-based Hardware Accelerator of RANSAC Algorithm for Matching of Images Feature Points

Implementation of Parallel Algorithm for Rasterization Processing

The FPGA-based Character Display and Its Application in Real Time Image Processing System

High-Performance FPGA-Based CNN Accelerator with Block-Floating-Point Arithmetic.

Accelerating Block-Matching and 3D Filtering-Based Image Denoising Algorithm on FPGAs

Parallel scanline algorithm for rapid rasterization of vector geographic data

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga

Graph processing method and device as well as rasterization representation and storage method

FPGA Acceleration of Color Interpolation Algorithm Based on Gradient and Color Difference

An Image Histogram Equalization Acceleration Method for Field-Programmable Gate Arrays Based on a Two-Dimensional Configurable Pipeline

A Raster Scan Radar Display with New Scan Converting Scheme and Advanced Graphics

A FPGA Implementation of Farneback Optical Flow by High-Level Synthesis