Abstract:Residual networks usually require more layers to achieve remarkable performance in complex visual categorization tasks, such as pose estimation. However, the increasing number of layers leads to a heavy burden on training and forward inference as well as over-fitting. This paper proposed local binary residual block (LBB) to promote the very deep residual networks on the trainable parameters, FLOPs and accuracy. In each LBB, the <math>3×3</math> filters are binarized based on Bernoulli distribution under a sparse constraint, an activation function is prepared to trigger the non-linear response, and the linear <math>1×1</math> filters are learned in a real-valued way. After stochastic binarized initialization, the <math>3×3</math> filters in LBB need not be updated during training. The above architecture reduces at least 69.2% trainable parameters and 70.5% FLOPs compared to the original model. The LBB is derived from three observations: 1) Activated responses of one standard <math>k×k</math> convolutional layer can be approximated by combining binarized <math>k×k</math> filters with <math>1×1</math> filters; 2) Most computation in the very deep residual networks is spent on the <math>3×3</math> convolutions; and 3) <math>1×1</math> filters play an important role in cross-channel information integration. In addition, the LBB module is suitable for the very deep network framework, including stacked hourglass network and pyramid residual modules. Experiments are conducted on MPII and LSP dataset for pose estimation task; CIFAR-10, CIFAR-100 and ImageNet datasets for object recognition; ECSSD, HKU-IS, PASCAL-S, DUT-OMRON, DUTS for saliency detection. The results show that our model can accelerate the training and inference of the network with only a slight performance degradation.

Eye Localization Based on Weight Binarization Cascade Convolution Neural Network

Eye State Detection Based on Weight Binarization Convolution Neural Network and Transfer Learning

A Novel Eye State Detection Method Via Wbcnn

Locatization of Human Eyes Based on a Series of Binary Images

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Accurate Gaze Estimation Based on Average‐binary‐connected‐component‐centroid

A robust eye detection method using combined binary edge and intensity information

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

Pupil localization algorithm based on lightweight convolutional neural network

Eye Localization Based On Face Alignment

Hybrid Iris Center Localization Method Using Cascaded Regression, Weighted Averaging, and Weighted Snakuscule

Predicting Eye Fixations Using Convolutional Neural Networks

2D Cascaded AdaBoost for Eye Localization

Bayesian Eye Tracking

Shape Constrained Network for Eye Segmentation in the Wild

Binarizing Sparse Convolutional Networks for Efficient Point Cloud Analysis

Weighted Bilinear Coding over Salient Body Parts for Person Re-Identification

Local-binarized very deep residual network for visual categorization

Context-Aware Local Binary Feature Learning for Face Recognition

A Complementary Dual-branch Network for Appearance-based Gaze Estimation from Low-resolution Facial Image

Multi-label ocular disease classification with a dense correlation deep neural network