Abstract:We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This results in 58×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} faster convolutional operations (in terms of number of the high precision operations) and 32×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} memory savings. XNOR-Nets offer the possibility of running state-of-the-art networks on CPUs (rather than GPUs) in real-time. Our binary networks are simple, accurate, efficient, and work on challenging visual tasks. We evaluate our approach on the ImageNet classification task. The classification accuracy with a Binary-Weight-Network version of AlexNet is the same as the full-precision AlexNet. We compare our method with recent network binarization methods, BinaryConnect and BinaryNets, and outperform these methods by large margins on ImageNet, more than 16%\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$16\,\%$$\end{document} in top-1 accuracy. Our code is available at: http://allenai.org/plato/xnornet.

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

Hyperbolic Binary Neural Network

GOENet: Group Operations Enhanced Binary Neural Network for Efficient Image Classification

MeliusNet: an Improved Network Architecture for Binary Neural Networks

MeliusNet: Can Binary Neural Networks Achieve MobileNet-level Accuracy?

Bi-Real Net V2: Rethinking Non-linearity for 1-Bit CNNs and Going Beyond

IE-Net: Information-Enhanced Binary Neural Networks for Accurate Classification

XNORAM: an Efficient Computing-in-Memory Architecture for Binary Convolutional Neural Networks with Flexible Dataflow Mapping.

GXNOR-Net: Training deep neural networks with ternary weights and activations without full-precision memory under a unified discretization framework

BoolNet: Minimizing The Energy Consumption of Binary Neural Networks

Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies.

Bi-Real Net: Enhancing the Performance of 1-Bit CNNs with Improved Representational Capability and Advanced Training Algorithm

Tbn: Convolutional Neural Network With Ternary Inputs And Binary Weights

ReActXGB: A Hybrid Binary Convolutional Neural Network Architecture for Improved Performance and Computational Efficiency

An adiabatic method to train binarized artificial neural networks

Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance

MajorityNets: BNNs Utilising Approximate Popcount for Improved Efficiency

CSA-Net: An Adaptive Binary Neural Network and Application on Remote Sensing Image Classification

Binarized Neural Networks on the ImageNet Classification Task

XNOR Neural Engine: A Hardware Accelerator IP for 21.6-fJ/op Binary Neural Network Inference