Abstract:In recent years, convolutional neural networks (CNNs) have demonstrated their ability to solve problems in many fields and with accuracy that was not possible before. However, this comes with extensive computational requirements, which made general CPUs unable to deliver the desired real-time performance. At the same time, FPGAs have seen a surge in interest for accelerating CNN inference. This is due to their ability to create custom designs with different levels of parallelism. Furthermore, FPGAs provide better performance per watt compared to GPUs. The current trend in FPGA-based CNN accelerators is to implement multiple convolutional layer processors (CLPs), each of which is tailored for a subset of layers. However, the growing complexity of CNN architectures makes optimizing the resources available on the target FPGA device to deliver optimal performance more challenging. In this paper, we present a CNN accelerator and an accompanying automated design methodology that employs metaheuristics for partitioning available FPGA resources to design a Multi-CLP accelerator. Specifically, the proposed design tool adopts simulated annealing (SA) and tabu search (TS) algorithms to find the number of CLPs required and their respective configurations to achieve optimal performance on a given target FPGA device. Here, the focus is on the key specifications and hardware resources, including digital signal processors, block RAMs, and off-chip memory bandwidth. Experimental results and comparisons using four well-known benchmark CNNs are presented demonstrating that the proposed acceleration framework is both encouraging and promising. The SA-/TS-based Multi-CLP achieves 1.31x - 2.37x higher throughput than the state-of-the-art Single-/Multi-CLP approaches in accelerating AlexNet, SqueezeNet 1.1, VGGNet, and GoogLeNet architectures on the Xilinx VC707 and VC709 FPGA boards.

A Solution To Optimize Multi-Operand Adders In Cnn Architecture On Fpga

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Optimization for Efficient Hardware Implementation of CNN on FPGA

An Efficient Design Flow for Accelerating Complicated-connected CNNs on a Multi-FPGA Platform.

Power Efficient Tiny Yolo CNN Using Reduced Hardware Resources Based on Booth Multiplier and WALLACE Tree Adders

Optimization of FPGA-based CNN Accelerators Using Metaheuristics

Optimization of Convolution Neural Network Algorithm Based on FPGA

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

A Memory-Optimized and Energy-Efficient CNN Acceleration Architecture Based on FPGA.

Optimizing of Convolutional Neural Network Accelerator

A Novel FPGA-based CNN Hardware Accelerator: Optimization for Convolutional Layers using Karatsuba Ofman Multiplier

Optimized Compression for Implementing Convolutional Neural Networks on FPGA

Optimizing Loop Operation and Dataflow in Fpga Acceleration of Deep Convolutional Neural Networks

A Grain-Adaptive Computing Structure for FPGA CNN Acceleration.

Towards Design Space Exploration and Optimization of Fast Algorithms for Convolutional Neural Networks (CNNs) on FPGAs

Optimizing the Convolution Operation to Accelerate Deep Neural Networks on FPGA

Improving the computational efficiency and flexibility of FPGA-based CNN accelerator through loop optimization

Full-stack Optimization for Accelerating CNNs with FPGA Validation

FPGA-based Accelerator for Convolutional Neural Network

CaFPGA: an Automatic Generation Model for CNN Accelerator.

FPGA deep learning acceleration based on convolutional neural network