Abstract:A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use reinforcement learning and evolutionary algorithm to search for the solution. However, most of them take a long time to find the optimal architecture due to the huge search space and the lengthy training process needed to evaluate each candidate. In addition, most of them aim at accuracy only and do not take into consideration the hardware that will be used to implement the architecture. This will potentially lead to excessive latencies beyond specifications, rendering the resulting architectures useless. To address both issues, in this paper we use Field Programmable Gate Arrays (FPGAs) as a vehicle to present a novel hardware-aware NAS framework, namely FNAS, which will provide an optimal neural architecture with latency guaranteed to meet the specification. In addition, with a performance abstraction model to analyze the latency of neural architectures without training, our framework can quickly prune architectures that do not satisfy the specification, leading to higher efficiency. Experimental results on common data set such as ImageNet show that in the cases where the state-of-the-art generates architectures with latencies 7.81x longer than the specification, those from FNAS can meet the specs with less than 1% accuracy loss. Moreover, FNAS also achieves up to 11.13x speedup for the search process. To the best of the authors' knowledge, this is the very first hardware aware NAS.

A Single Layer Architecture to FPGA Implementation of BP Artificial Neural Network

Realization and Application of BP Neural Network in LabVIEW

Implementation of Artificial Neural Network for Real Time Applications Using Field Programmable Analog Arrays

Implementation of Band-Block FIR Filters Designed Based on BP Neural Network

Performance analysis of multiple input single layer neural network hardware chip

FP-BNN: Binarized neural network on FPGA

Hardware implementation of an on-chip BP learning neural network with programmable neuron characteristics and learning rate adaptation

Application of the Improved BP Neural Network in Ship and Ocean Engineering

A Real-time P-SFA hardware implementation of Deep Neural Networks using FPGA

Study on Improved FIR Filters Using BP Neural Networks

Hardware Realization of Building Blocks for Artificial Neural Networks

Binary Neural Networks in FPGAs: Architectures, Tool Flows and Hardware Comparisons

ASIC Design of Nanoscale Artificial Neural Networks for Inference/Training by Floating-Point Arithmetic

A programmable on-chip BP learning neural network with enhanced neuron characteristics

A General Neural Network Hardware Architecture on FPGA

FPGA implementation of hardware processing modules as coprocessors in brain-machine interfaces.

A FPGA-based Hardware Accelerator for Bayesian Confidence Propagation Neural Network

Method for implementing feedforward neural network by using digital and analog circuits

Hardware implementation of spiking neural networks on FPGA

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification