Abstract:Binocular stereo vision is a depth estimation technique by imitating human eyes. It is widely used in various fields, such as self-driving cars, SLAM, and 3D reconstruction. However, designing a hardware architecture that can balance resource utilization, processing speed, and estimation accuracy remains a significant challenge. This paper proposes a compact and efficient hardware-based design that incorporates linear fitting-based cost fusion, disparity optimization with subpixel interpolation, and multi-directional occlusion filling techniques. Firstly, a gradient-enhanced pipelined matching costs architecture with a resource-saving scheme and re-computation paradigm is proposed to improve the accuracy of edge information. Then, we approximate the nonlinear exponential function by linear fitting to save the hardware resource. Moreover, we design the subpixel interpolation with an SRT radix-4 divider to refine the disparity, which significantly enhances the accuracy of the disparity map in real situations. Finally, we proposed a resource-reused architecture for synchronous hole filling and median filter in post-processing. The disparity map quality of the proposed architecture is evaluated on KITTI2015 datasets, which delivers leading accuracy compared to other state-of-the-art works. The architecture has been successfully implemented and demonstrated on the Stratix-V FPGA platform and achieved 54 frames per second operating at 112 MHz under a resolution of $1920\times 1080$ .

An FPGA-based 3D-2D RANSAC Architecture for Matching Feature Points in RGB-D Slam

An FPGA-based Hardware Accelerator of RANSAC Algorithm for Matching of Images Feature Points

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

A Real-Time and High Precision Hardware Implementation of RANSAC Algorithm for Visual SLAM Achieving Mismatched Feature Point Pair Elimination

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

FPGA implementation of full HD real-time depth estimation

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

An FPGA Acceleration and Optimization Techniques for 2D LiDAR SLAM Algorithm

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

A Hardware Architecture of Feature Extraction for Real-Time Visual SLAM.

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

FPGA-based Acceleration of Structured Light Depth Estimation

CNN-based Feature-point Extraction for Real-time Visual SLAM on Embedded FPGA

A Real-Time and Efficient Optical Flow Tracking Accelerator on FPGA Platform

Distribution-aware FAST Feature Point Extraction and Matching Based on FPGA

An FPGA-based RGBD Imager

Stereo Matching Accelerator With Re-Computation Scheme and Data-Reused Pipeline for Autonomous Vehicles

A Real-time AD-Census Stereo Matching based on FPGA