Abstract:Residual networks usually require more layers to achieve remarkable performance in complex visual categorization tasks, such as pose estimation. However, the increasing number of layers leads to a heavy burden on training and forward inference as well as over-fitting. This paper proposed local binary residual block (LBB) to promote the very deep residual networks on the trainable parameters, FLOPs and accuracy. In each LBB, the <math>3×3</math> filters are binarized based on Bernoulli distribution under a sparse constraint, an activation function is prepared to trigger the non-linear response, and the linear <math>1×1</math> filters are learned in a real-valued way. After stochastic binarized initialization, the <math>3×3</math> filters in LBB need not be updated during training. The above architecture reduces at least 69.2% trainable parameters and 70.5% FLOPs compared to the original model. The LBB is derived from three observations: 1) Activated responses of one standard <math>k×k</math> convolutional layer can be approximated by combining binarized <math>k×k</math> filters with <math>1×1</math> filters; 2) Most computation in the very deep residual networks is spent on the <math>3×3</math> convolutions; and 3) <math>1×1</math> filters play an important role in cross-channel information integration. In addition, the LBB module is suitable for the very deep network framework, including stacked hourglass network and pyramid residual modules. Experiments are conducted on MPII and LSP dataset for pose estimation task; CIFAR-10, CIFAR-100 and ImageNet datasets for object recognition; ECSSD, HKU-IS, PASCAL-S, DUT-OMRON, DUTS for saliency detection. The results show that our model can accelerate the training and inference of the network with only a slight performance degradation.

Efficient Layout Hotspot Detection Via Binarized Residual Neural Network

Efficient Layout Hotspot Detection Via Neural Architecture Search

Efficient Hotspot Detection Via Graph Neural Network

Modified Deep Learning Approach for Layout Hotspot Detection

Hotspot Detection Via Attention-Based Deep Layout Metric Learning

Automated and Agile Design of Layout Hotspot Detector via Neural Architecture Search

Enhancing Layout Hotspot Detection Efficiency with YOLOv8 and PCA-Guided Augmentation

Faster Region-based Hotspot Detection.

Imbalance aware lithography hotspot detection: a deep learning approach

Lithography Hotspot Detection Method Based on Transfer Learning Using Pre-Trained Deep Convolutional Neural Network

BiPointNet: Binary Neural Network for Point Clouds

BDC-Occ: Binarized Deep Convolution Unit For Binarized Occupancy Network

Litho-NeuralODE 2.0: Improving Hotspot Detection Accuracy with Advanced Data Augmentation, DCT-based Features, and Neural Ordinary Differential Equations

BiDet: An Efficient Binarized Object Detector

Local-binarized very deep residual network for visual categorization

Binarized Graph Neural Network

Learning Efficient Binarized Object Detectors With Information Compression

Tiny-BDN: an Efficient and Compact Barcode Detection Network

Lightweight Hotspot Detection Model Fusing SE and ECA Mechanisms

Binarized Neural Networks on the ImageNet Classification Task

TB-DNN: A Thin Binarized Deep Neural Network with High Accuracy