Abstract:We introduce a novel and generic convolutional unit, DiCE unit, that is built using dimension-wise convolutions and dimension-wise fusion. The dimension-wise convolutions apply light-weight convolutional filtering across each dimension of the input tensor while dimension-wise fusion efficiently combines these dimension-wise representations; allowing the DiCE unit to efficiently encode spatial and channel-wise information contained in the input tensor. The DiCE unit is simple and can be seamlessly integrated with any architecture to improve its efficiency and performance. Compared to depth-wise separable convolutions, the DiCE unit shows significant improvements across different architectures. When DiCE units are stacked to build the DiCENet model, we observe significant improvements over state-of-the-art models across various computer vision tasks including image classification, object detection, and semantic segmentation. On the ImageNet dataset, the DiCENet delivers 2-4% higher accuracy than state-of-the-art manually designed models (e.g., MobileNetv2 and ShuffleNetv2). Also, DiCENet generalizes better to tasks (e.g., object detection) that are often used in resource-constrained devices in comparison to state-of-the-art separable convolution-based efficient networks, including neural search-based methods (e.g., MobileNetv3 and MixNet. Our source code in PyTorch is open-source and is available at <a class="link-external link-https" href="https://github.com/sacmehta/EdgeNets/" rel="external noopener nofollow">this https URL</a>

Aggregated Squeeze-and-excitation Transformations for Densely Connected Convolutional Networks

SENetV2: Aggregated dense layer for channelwise and global representations

Squeeze Excitation Densely Connected Residual Convolutional Networks for Specific Emitter Identification Based on Measured Signals

DiCENet: Dimension-wise Convolutions for Efficient Networks

Squeeze aggregated excitation network

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Dilated Residual Encode-Decode Networks for Image Denoising

Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks

Multi-scale Convolution Aggregation and Stochastic Feature Reuse for DenseNets

Convolutional Networks with Dense Connectivity

A Lightweight Block with Information Flow Enhancement for Convolutional Neural Networks

Efficient densely connected convolutional neural networks

Competitive Inner-Imaging Squeeze and Excitation for Residual Network

Delving deep into spatial pooling for squeeze-and-excitation networks

Residual squeeze CNDS deep learning CNN model for very large scale places image recognition

Learning Efficient Convolutional Networks Through Network Slimming.

Self Expanding Convolutional Neural Networks

Gated Channel Transformation for Visual Recognition

CTA-Net: A CNN-Transformer Aggregation Network for Improving Multi-Scale Feature Extraction

A Survey of Model Compression and Acceleration for Deep Neural Networks.

M-Sosanet : An Efficient Convolution Network Backbone For Embedding Devices