Abstract:In the digital era, the prevalence of low-quality images contrasts with the widespread use of high-definition displays, primarily due to low-resolution cameras and compression technologies. Image super-resolution (SR) techniques, particularly those leveraging deep learning, aim to enhance these images for high-definition presentation. However, real-time execution of deep neural network (DNN)-based SR methods at the edge poses challenges due to their high computational and storage requirements. To address this, field-programmable gate arrays (FPGAs) have emerged as a promising platform, offering flexibility, programmability, and adaptability to evolving models. Previous FPGA-based SR solutions have focused on reducing computational and memory costs through aggressive simplification techniques, often sacrificing the quality of the reconstructed images. This paper introduces a novel SR network specifically designed for edge applications, which maintains reconstruction performance while managing computation costs effectively. Additionally, we propose an architectural design that enables the real-time and end-to-end inference of the proposed SR network on embedded FPGAs. Our key contributions include a tailored SR algorithm optimized for embedded FPGAs, a DSP-enhanced design that achieves a significant four-fold speedup, a novel scalable cache strategy for handling large feature maps, optimization of DSP cascade consumption, and a constraint optimization approach for resource allocation. Experimental results demonstrate that our FPGA-specific accelerator surpasses existing solutions, delivering superior throughput, energy efficiency, and image quality.

A High Performance Parallel Computing Architecture For Robust Image Features

FPGA-Based Parallel Implementation of SURF Algorithm

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

FPGA-based Efficient Implementation of SURF Algorithm

Implementation of High Performance Hardware Architecture of OpenSURF Algorithm on FPGA

Optimization of Speeded-Up Robust Feature Algorithm for Hardware Implementation

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

On-Board Detection and Matching of Feature Points

Dsp-Based Parallel Implementation Of Speeded-Up Robust Features

Parallel and Pipelining design of SLAM Feature Detection Algorithm in Hardware

SRI-SURF: A better SURF powered by scaled-RAM interpolator on FPGA

Novel many-core architecture design for real-time image processing

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

FPGA-based Binocular Image Feature Extraction and Matching System

Parallel Hough Transform-based straight line detection and its FPGA implementation in embedded vision

Implementation of Parallel Acceleration for Real-time Extraction of Visual Features.

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System

Hardware Architecture for Fast General Object Detection using Aggregated Channel Features

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga