Abstract:With the continuous development of neural networks for computer vision tasks, more and more network architectures have achieved outstanding success. As one of the most advanced neural network architectures, DenseNet shortcuts all feature maps to solve the model depth problem. Although this network architecture has excellent accuracy with low parameters, it requires an excessive inference time. To solve this problem, HarDNet reduces the connections between the feature maps, making the remaining connections resemble harmonic waves. However, this compression method may result in a decrease in the model accuracy and an increase in the parameters and model size. This network architecture may reduce the memory access time, but its overall performance can still be improved. Therefore, we propose a new network architecture, ThreshNet, using a threshold mechanism to further optimize the connection method. Different numbers of connections for different convolution layers are discarded to accelerate the inference of the network. The proposed network has been evaluated with image classification using CIFAR 10 and SVHN datasets under platforms of NVIDIA RTX 3050 and Raspberry Pi 4. The experimental results show that, compared with HarDNet68, GhostNet, MobileNetV2, ShuffleNet, and EfficientNet, the inference time of the proposed ThreshNet79 is 5%, 9%, 10%, 18%, and 20% faster, respectively. The number of parameters of ThreshNet95 is 55% less than that of HarDNet85. The new model compression and model acceleration methods can speed up the inference time, enabling network models to operate on mobile devices.

An Efficient Way to Refine DenseNet.

Efficient Structure Slimming for Spiking Neural Networks

Learning both Weights and Connections for Efficient Neural Network

ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connections

Automl For Densenet Compression

Connection Reduction of DenseNet for Image Recognition

S-DenseNet: A DenseNet Compression Model Based on Convolution Grouping Strategy Using Skyline Method.

CondenseNet V2: Sparse Feature Reactivation for Deep Networks

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Memory-Efficient Implementation of DenseNets

Efficient densely connected convolutional neural networks

Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures

Log-DenseNet: How to Sparsify a DenseNet

Additive DenseNet: Dense Connections Based on Simple Addition Operations

Dense Optimizer : An Information Entropy-Guided Structural Search Method for Dense-like Neural Network Design

ResNet or DenseNet? Introducing Dense Shortcuts to ResNet

RefineNet: Multi-Path Refinement Networks for Dense Prediction

A Dynamic Pruning Method on Multiple Sparse Structures in Deep Neural Networks

Automatic DenseNet Sparsification.

ResNet Can Be Pruned 60x: Introducing Network Purification and Unused Path Removal (P-RM) after Weight Pruning

HarDNet: A Low Memory Traffic Network