Abstract:Convolutional Neural Networks have dramatically improved in recent years, surpassing human accuracy on certain problems and performance exceeding that of traditional computer vision algorithms. While the compute pattern in itself is relatively simple, significant compute and memory challenges remain as CNNs may contain millions of floating-point parameters and require billions of floating-point operations to process a single image. These computational requirements, combined with storage footprints that exceed typical cache sizes, pose a significant performance and power challenge for modern compute architectures. One of the promising opportunities to scale performance and power efficiency is leveraging reduced precision representations for all activations and weights as this allows to scale compute capabilities, reduce weight and feature map buffering requirements as well as energy consumption. While a small reduction in accuracy is encountered, these Quantized Neural Networks have been shown to achieve state-of-the-art accuracy on standard benchmark datasets, such as MNIST, CIFAR-10, SVHN and even ImageNet, and thus provide highly attractive design trade-offs. Current research has focused mainly on the implementation of extreme variants with full binarization of weights and or activations, as well typically smaller input images. Within this paper, we investigate the scalability of dataflow architectures with respect to supporting various precisions for both weights and activations, larger image dimensions, and increasing numbers of feature map channels. Key contributions are a formalized approach to understanding the scalability of the existing hardware architecture with cost models and a performance prediction as a function of the target device size. We provide validating experimental results for an ImageNet classification on a server-class platform, namely the AWS F1 node.

Convolution neural network compression method with scale factor

DCCD: Reducing Neural Network Redundancy Via Distillation

A Model Compression Method Using Significant Data and Knowledge Distillation

Research on Image Classification Method of Features of Combinatorial Convolution

Efficient and Flexible Method for Reducing Moderate-size Deep Neural Networks with Condensation

Efficient Network Compression Through Smooth-Lasso Constraint

Low-precision CNN Model Quantization based on Optimal Scaling Factor Estimation

Few Sample Knowledge Distillation for Efficient Network Compression

Pruning by Training: A Novel Deep Neural Network Compression Framework for Image Processing.

Sensitivity-based Acceleration and Compression Algorithm for Convolution Neural Network.

A deep neural network compression algorithm based on knowledge transfer for edge devices

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Compressing complex convolutional neural network based on an improved deep compression algorithm

A Novel Deep Learning Model Compression Algorithm

ScaleGCN: Efficient and Effective Graph Convolution Via Channel-Wise Scale Transformation.

Efficient Neural Network Compression Inspired by Compressive Sensing.

Improving Crowd Counting with Scale‐aware Convolutional Neural Network

Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization

Scaling Neural Network Performance through Customized Hardware Architectures on Reconfigurable Logic

Efficient Variable Rate Image Compression With Multi-Scale Decomposition Network

A Down-sampling Method Based on the Discrete Wavelet Transform for CNN Classification