Abstract:Binarized neural networks (BNNs), which have 1-bit weights and activations, are well suited for FPGA accelerators as their dominant computations are bitwise arithmetic, and the reduction in memory requirements means that all the network parameters can be stored in internal memory. However, the energy efficiency of these accelerators is still restricted by the abundant redundancies in BNNs. This hinders their deployment for applications in smart sensors and tiny devices because these scenarios have tight constraints with respect to energy consumption. To overcome this problem, we propose an approach to implement BNN inference while offering excellent energy efficiency for the accelerators by means of pruning the massive redundant operations while maintaining the original accuracy of the networks. Firstly, inspired by the observation that the convolution processes of two related kernels contain many repeated computations, we first build one formula to clarify the reusing relationships between their convolutional outputs and remove the unnecessary operations. Furthermore, by generalizing this reusing relationship to one tile of kernels in one neuron, we adopt an inclusion pruning strategy to further skip the superfluous evaluations of the neurons whose real output values can be determined early. Finally, we evaluate our system on the Zynq 7000 XC7Z100 FPGA platform. Our design can prune 51 percent of the operations without any accuracy loss. Meanwhile, the energy efficiency of our system is as high as 6.55 × 105 Img/kJ, which is 118× better than the best accelerator based on an NVDIA Tesla-V100 GPU and 3.6× higher than the state-of-the-art FPGA implementations for BNNs.

Efficient Performance Trade-off Modeling for Analog Circuit Based on Bayesian Neural Network.

Bayesian Optimization Approach for Analog Circuit Synthesis Using Neural Network.

An Efficient Bayesian Optimization Approach for Automated Optimization of Analog Circuits.

Hardware Platform-Aware Binarized Neural Network Model Optimization

Yield Optimization for Analog Circuits over Multiple Corners Via Bayesian Neural Networks: Enhancing Circuit Reliability under Environmental Variation

Bayesian Optimization Approach for RF Circuit Synthesis Via Multitask Neural Network Enhanced Gaussian Process

An Efficient Multi-fidelity Bayesian Optimization Approach for Analog Circuit Synthesis

Efficient Performance Modeling for Automated CMOS Analog Circuit Synthesis

Extraction and use of neural network models in automated synthesis of operational amplifiers

Efficient Hierarchical Performance Modeling for Analog and Mixed-Signal Circuits Via Bayesian Co-Learning

Transfer learning with bayesian optimization-aided sampling for efficient AMS circuit modeling

Bayesian Optimization Approach for Analog Circuit Design Using Multi-Task Gaussian Process

Efficient Performance Modeling Via Dual-Prior Bayesian Model Fusion for Analog and Mixed-Signal Circuits

Exploiting Near-Memory Processing Architectures for Bayesian Neural Networks Acceleration

Efficient Hybrid Performance Modeling for Analog Circuits Using Hierarchical Shrinkage Priors

Model Architecture Adaption for Bayesian Neural Networks

An Approach of Binary Neural Network Energy-Efficient Implementation

Benchmarking Artificial Neural Network Models for Design Technology Co-optimization

Practical Layout-Aware Analog/Mixed-Signal Design Automation with Bayesian Neural Networks

Correlated Bayesian Model Fusion: Efficient High-Dimensional Performance Modeling of Analog/RF Integrated Circuits over Multiple Corners

High-Performance FPGA-based Accelerator for Bayesian Neural Networks