Abstract:Binocular stereo vision is a commonly applied computer vision technique with a wide range of applications in 3D scene perception. However, binocular stereo matching algorithms are computationally intensive and complicated. In addition, some traditional platforms are unable to meet the real-time and energy efficient dual requirements. In this paper, we proposed a hardware/software co-design FPGA (Field Programmable Gate Array) approach to overcome these limitations. Based on the characteristics of binocular stereo vision, we modularize the system functions to achieve the hardware/software partitioning. This accelerates the data processing on the FPGA, while simultaneously performing data control on the ARM (Advanced RISC Machine) cores. The parallelism of the FPGA allows for a full-pipeline design that is synchronized with an identical system clock for the simultaneous running of multiple stereo processing components, thus improving the processing speed. Furthermore, to minimize hardware costs, the collected images and data are compressed prior to matching, while the precision is subsequently enhanced during post-processing. The proposed system was evaluated on the PYNQ-Z2 development board, with experimental results revealing its high real-time performance and low power consumption for a 100M clock frequency. Compared with existing designs, the simple yet flexible system demonstrated a higher image processing speed and less hardware resource overhead (thus lower power consumption). The average error rate of the BM matching algorithm was also improved, particularly with the limited PYNQ-Z2 hardware resource. The proposed system has been opened on GitHub.

Improvement on SGM-based Stereo Matching Algorithm and FPGA Implementation

Study on the Real-Time Stereo Matching Based on TMS320C64x

A FPGA Stereo Matching Algorithm Modeled by DSP Builder.

A Parallel Stereo Matching Algorithm Core for FPGA Modeled by DSP Builder

Sad-Based Stereo Vision Machine on A System-On-Programmable-Chip (Sopc)

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

PC Based Real-Time Implementation for Regional Matching in Stereo Vision

A Resource-Efficient Pipelined Architecture for Real-Time Semi-Global Stereo Matching

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Real-time Stereo Vision System Using Adaptive Weight Cost Aggregation Approach

Algorithm and VLSI Architecture Co-Design on Efficient Semi-Global Stereo Matching.

Low-Resource Hardware Architecture For Semi-Global Stereo Matching

Research and implementation of adaptive stereo matching algorithm based on ZYNQ

An Improved Global Stereo-Matching on FPGA for Real-Time Applications (abstract Only)

Real-time low-power binocular stereo vision based on FPGA

Stereo Matching Accelerator With Re-Computation Scheme and Data-Reused Pipeline for Autonomous Vehicles

High Throughput Hardware Architecture for Accurate Semi-Global Matching.

A Real-Time Global Stereo-Matching on Fpga

NIPM-sWMF: Toward Efficient FPGA Design for High-Definition Large-Disparity Stereo Matching

The SGM Algorithm Based on Census Transform for Binocular Stereo Vision

Stereo matching algorithm using improved guided filtering