Abstract:Optical flow algorithm, which estimates the motion detection of consequent video frames, is widely used in surveillance system, Advanced Driver Assistance Systems (ADAS) and object movement estimation in scene analysis. Among different optical flow algorithms, Farneback version provides a better accuracy and brightness-change-resistant displacements by estimating the flow from polynomial domain rather than intensive maps. However, high computation complexity and inconsistent data access patterns make it difficult to be implemented on a hardware platform. In this work, we present a micro-architecture design of Farneback optical flow, which is flexible for optimization with high level Synthesis (HLS) tools. The original software-based implementation was decomposed into functional blocks to balance latency of different stages and flows of data were rearranged to accommodate better memory access patterns. The data flow arrangement is based on a proposed backtrace mechanism, where DRAM accesses of polynomial coefficients in current frame makes consistent traffic patterns, and therefore make it possible to integrate more functional blocks into a deeper pipeline. For several micro-architecture design versions, we demonstrate options of fixed and floating points, optimization techniques such as multiple DMAs and different levels of pipeline integration. We implemented our design on Zedboard Mini-ITX 7045. The results show a 17x end-to-end speedup against a naive HLS version with an image size of 160x120. Considering only the hardware-accelerated part, our FPGA implementation is 40x faster than the naive HLS version with only 50% of the FPGA hardware resources.

FPGA Implementation of Fast Phong Shader

Design and Implementation of Visual Processing System Based on FPGA

Design of Structured Light Depth Detection System Based on FPGA

FPGA-based hardware implementation of new edge-directed interpolation algorithm

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Real-time FPGA Implementation of an Optic Flow Algorithm Suitable for Background Oriented Schlieren Technique

A Hardware Algorithm for Graphics Rasterizer

FPGA implementation of full HD real-time depth estimation

Hardware Implementation of Configurable High-speed and High-precision FFT

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga

A FPGA Implementation of Farneback Optical Flow by High-Level Synthesis

Study of Hardware Implementations of Fast Tracking Algorithms

FPGA Implementation of High Speed FFT Algorithm Based on Split-Radix

Fast FPGA Placement Algorithm Based on Quantum Model

Programmable Pixel Shader for Mobile Devices

Design of geometry transformation unit and its FPGA implementation

An FPGA-Optimized Architecture of Real-time Farneback Optical Flow

Realization of Texture Mapping on FPGA

Implementation of digital phosphor display algorithm based on SoC FPGA

Tile-based Multiple Parallel Triangle Rasterization Algorithm Implemented in FPGA

New Fast FPGA Placer