Abstract:Binocular stereo vision is a commonly applied computer vision technique with a wide range of applications in 3D scene perception. However, binocular stereo matching algorithms are computationally intensive and complicated. In addition, some traditional platforms are unable to meet the real-time and energy efficient dual requirements. In this paper, we proposed a hardware/software co-design FPGA (Field Programmable Gate Array) approach to overcome these limitations. Based on the characteristics of binocular stereo vision, we modularize the system functions to achieve the hardware/software partitioning. This accelerates the data processing on the FPGA, while simultaneously performing data control on the ARM (Advanced RISC Machine) cores. The parallelism of the FPGA allows for a full-pipeline design that is synchronized with an identical system clock for the simultaneous running of multiple stereo processing components, thus improving the processing speed. Furthermore, to minimize hardware costs, the collected images and data are compressed prior to matching, while the precision is subsequently enhanced during post-processing. The proposed system was evaluated on the PYNQ-Z2 development board, with experimental results revealing its high real-time performance and low power consumption for a 100M clock frequency. Compared with existing designs, the simple yet flexible system demonstrated a higher image processing speed and less hardware resource overhead (thus lower power consumption). The average error rate of the BM matching algorithm was also improved, particularly with the limited PYNQ-Z2 hardware resource. The proposed system has been opened on GitHub.

Technology of Video Signal Acquisition Based on FPGA

Design and Implementation of Visual Processing System Based on FPGA

High speed video signal acquisition and processing system based on FPGA technique

Real-time video processing model for stereoscopic display system based on FPGA

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Stereoscopic to Multi-view Video Conversion System FPGA Implementation

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

Real-time 3D Video System Based on FPGA

A real-time multi-view interlacing architecture for auto-stereoscopic 3DTV display based on FPGA

Improved real-time correlation-based FPGA stereo vision system

FPGA implementation of full HD real-time depth estimation

Design of a Video Processor Based on FPGA

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

Intelligent Door Control System Based on FPGA + ARM

Video Controller System by Using Field Sequential Color

Real-Time High-Quality Stereo Vision System in FPGA

Design and Lmplementation of FPGA-based 3D Video Picture Segmentation Module

Real-time low-power binocular stereo vision based on FPGA

Real-time Multi-View Rendering Based on FPGA

FPGA-Based Image Processing for Seamless Tiled Display System