Abstract:In the digital era, the prevalence of low-quality images contrasts with the widespread use of high-definition displays, primarily due to low-resolution cameras and compression technologies. Image super-resolution (SR) techniques, particularly those leveraging deep learning, aim to enhance these images for high-definition presentation. However, real-time execution of deep neural network (DNN)-based SR methods at the edge poses challenges due to their high computational and storage requirements. To address this, field-programmable gate arrays (FPGAs) have emerged as a promising platform, offering flexibility, programmability, and adaptability to evolving models. Previous FPGA-based SR solutions have focused on reducing computational and memory costs through aggressive simplification techniques, often sacrificing the quality of the reconstructed images. This paper introduces a novel SR network specifically designed for edge applications, which maintains reconstruction performance while managing computation costs effectively. Additionally, we propose an architectural design that enables the real-time and end-to-end inference of the proposed SR network on embedded FPGAs. Our key contributions include a tailored SR algorithm optimized for embedded FPGAs, a DSP-enhanced design that achieves a significant four-fold speedup, a novel scalable cache strategy for handling large feature maps, optimization of DSP cascade consumption, and a constraint optimization approach for resource allocation. Experimental results demonstrate that our FPGA-specific accelerator surpasses existing solutions, delivering superior throughput, energy efficiency, and image quality.

Design and Implementation of an Improved Unsharp Masking Real-Time Image Enhancement Method Based on FPGA

Design and Implementation of Visual Processing System Based on FPGA

Live Video Analytics with FPGA-based Smart Cameras

High speed video signal acquisition and processing system based on FPGA technique

Research of high speed image processing system based on FPGA

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Implementation of Improved Median Filtering Algorithm in Real-time and High-speed

FPGA Based Real-Time Image Filtering and Edge Detection

FPGA implementation of full HD real-time depth estimation

Real-time hardware accelerator for single image haze removal using dark channel prior and guided filter

An adaptive edge enhancement algorithm and hardware implementation

Design and Implement of Median Filter Toward Remote Sensing Images Based on FPGA

Parallel Implementation and Optimization of High Definition Video Real-Time Dehazing

Design of high-speed real-time sensor image processing based on FPGA and DDR3

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

FPGA-Based Real-Time Super-Resolution System for Ultra High Definition Videos

Image Denoising Method Based on FPGA in Digital Video Image Transmission System

FPGA-based Efficient Implementation of SURF Algorithm

Unsharp masking image enhancement the parallel algorithm based on cross-platform