Abstract:To meet the demands of real-time displacement detection in embedded systems, a real-time optical flow calculation method suitable for background oriented schlieren (BOS) technology was transplanted and implemented on an Field Programmable Gate Array(FPGA) system. Firstly, through the analysis of different optical flow operation characteristics and the comparison of processing results in MATLAB with actual experimental data, an optical flow algorithm suitable for real-time processing of background shadow images was selected. Subsequently, by using hardware pipelining and multimodule parallel processing, the single-layer L&K optical flow algorithm was transplanted onto the FPGA and algorithm optimization was performed to achieve real-time optical flow calculation based on adjacent frame images. The key optimization techniques in this paper mainly include cleverly designing Double-Data-Rate Three Synchronous Dynamic Random Access Memory (DDR3) memory partitioning read and write logic to avoid image read and write conflicts; ensuring the timing alignment and data synchronization of consecutive frames by using burst read arbitration modules and two independent First In First Out (FIFO) buffers; and in optical flow calculation, constructing a 3×3 window using a shifting FIFO method to effectively save cache resources and improve computational speed. Experimental results show that the system can achieve real-time processing speeds of not less than 60fps for 1024×768 resolution images, meeting the requirements of practical applications.

Realization of Texture Mapping on FPGA

GPU-Based Texture Encoding and Real-Time Rendering

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

FPGA implementation of full HD real-time depth estimation

Design of Image Sampling and Storage System Based on FPGA

FPGA-Based Image Processing for Seamless Tiled Display System

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA Implementation of Fast Phong Shader

Real-time Hardware Implementation of 2-D Convolution-Based Image Interpolation

Design of high-speed real-time sensor image processing based on FPGA and DDR3

CNN-based Feature-point Extraction for Real-time Visual SLAM on Embedded FPGA

Design and implementation of matrix circuit for 3D perspective correct texturing mapping

A Hardware Algorithm for Graphics Rasterizer

Real-time FPGA Implementation of an Optic Flow Algorithm Suitable for Background Oriented Schlieren Technique

On-Board Detection and Matching of Feature Points

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga

LUT-based FPGA Technology Mapping: A Simulated Annealing Approach

Real-time Image Processing System Using FPGA with Hardware Software Collaborative Processing

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Design of Large-Array CMOS Real-Time Imaging System Based on FPGA

An Architecture Independent Packing Method for LUT-based Commercial FPGA.