Abstract:Binocular stereo vision is a depth estimation technique by imitating human eyes. It is widely used in various fields, such as self-driving cars, SLAM, and 3D reconstruction. However, designing a hardware architecture that can balance resource utilization, processing speed, and estimation accuracy remains a significant challenge. This paper proposes a compact and efficient hardware-based design that incorporates linear fitting-based cost fusion, disparity optimization with subpixel interpolation, and multi-directional occlusion filling techniques. Firstly, a gradient-enhanced pipelined matching costs architecture with a resource-saving scheme and re-computation paradigm is proposed to improve the accuracy of edge information. Then, we approximate the nonlinear exponential function by linear fitting to save the hardware resource. Moreover, we design the subpixel interpolation with an SRT radix-4 divider to refine the disparity, which significantly enhances the accuracy of the disparity map in real situations. Finally, we proposed a resource-reused architecture for synchronous hole filling and median filter in post-processing. The disparity map quality of the proposed architecture is evaluated on KITTI2015 datasets, which delivers leading accuracy compared to other state-of-the-art works. The architecture has been successfully implemented and demonstrated on the Stratix-V FPGA platform and achieved 54 frames per second operating at 112 MHz under a resolution of $1920\times 1080$ .

A Parallel Stereo Matching Algorithm Core for FPGA Modeled by DSP Builder

A FPGA Stereo Matching Algorithm Modeled by DSP Builder.

Study on the Real-Time Stereo Matching Based on TMS320C64x

Sad-Based Stereo Vision Machine on A System-On-Programmable-Chip (Sopc)

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Improved real-time correlation-based FPGA stereo vision system

Design and Implementation of Visual Processing System Based on FPGA

PC Based Real-Time Implementation for Regional Matching in Stereo Vision

Real-time Stereo Vision System Using Adaptive Weight Cost Aggregation Approach

Census Stereo Matching based on DSP

A Real-time AD-Census Stereo Matching based on FPGA

Real-Time High-Quality Stereo Vision System in FPGA

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

FPGA implementation of full HD real-time depth estimation

FP-Stereo: Hardware-Efficient Stereo Vision for Embedded Applications

High Level Synthesis of Stereo Matching: Productivity, Performance, and Software Constraints

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA based memory efficient high resolution stereo vision system for video tolling

Stereo Matching Accelerator With Re-Computation Scheme and Data-Reused Pipeline for Autonomous Vehicles