Abstract:We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This results in 58×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} faster convolutional operations (in terms of number of the high precision operations) and 32×\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\times $$\end{document} memory savings. XNOR-Nets offer the possibility of running state-of-the-art networks on CPUs (rather than GPUs) in real-time. Our binary networks are simple, accurate, efficient, and work on challenging visual tasks. We evaluate our approach on the ImageNet classification task. The classification accuracy with a Binary-Weight-Network version of AlexNet is the same as the full-precision AlexNet. We compare our method with recent network binarization methods, BinaryConnect and BinaryNets, and outperform these methods by large margins on ImageNet, more than 16%\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$16\,\%$$\end{document} in top-1 accuracy. Our code is available at: http://allenai.org/plato/xnornet.

GOENet: Group Operations Enhanced Binary Neural Network for Efficient Image Classification

IE-Net: Information-Enhanced Binary Neural Networks for Accurate Classification

Cellular Binary Neural Network for Accurate Image Classification and Semantic Segmentation

Towards Diverse Binary Segmentation via a Simple yet General Gated Network

GM-Net: Learning Features with more Efficiency

SCGNet: Shifting and Cascaded Group Network

CSA-Net: An Adaptive Binary Neural Network and Application on Remote Sensing Image Classification

Bi-Real Net V2: Rethinking Non-linearity for 1-Bit CNNs and Going Beyond

Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation.

HENet:A Highly Efficient Convolutional Neural Networks Optimized for Accuracy, Speed and Storage

LC-BiDet: Laterally Connected Binary Detector with Efficient Image Processing

FMGNet: an Efficient Feature-Multiplex Group Network for Real-Time Vision Task

VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

Training Compact Neural Networks with Binary Weights and Low Precision Activations

RB-Net: Training Highly Accurate and Efficient Binary Neural Networks with Reshaped Point-Wise Convolution and Balanced Activation

Balanced Binary Neural Networks with Gated Residual

Separable Binary Convolutional Neural Network on Embedded Systems

Model encoding of binary neural networks

Image Semantic Segmentation Using Improved ENet Network