Abstract:Depth-wise convolution has become very popular recently, owing to research on efficient convolutional networks. However, it performs convolution in each channel separately, therefore, decreases the representational power of features. In this thesis, we take a systematic research on the architecture and shortcomings of depth-wise convolution. We observe that combining the benefits of multibranch depth-wise operation, shared channel modulation, and feature fusion brings us considerable improvements on both computation accuracy and convolution efficiency. This simple yet effective idea enables us to propose a novel channel-modulated multibranch convolution (CMMB-Conv). In our approach, we first use a multibranch depth-wise operation on the input feature maps to increase the channel width. Next, we gather the spatial information of feature maps from multiple branches through Max and Average Pooling layers. Followed by this, a shared hidden neural perceptron is employed to modulate the inter-channel relationship of the feature maps. Finally, we concatenate the multibranch-modulated feature maps and fuse them by using the point-wise convolution. Compared with feature maps extracted by the depth-wise separable convolution, the feature maps resulting from our CMMBConv have strong representation capability, improving the accuracy of existing MobileNets on both ImageNet and CIFAR classification. Extensive experimental results on the ImageNet2012 have shown that our CMMBConv can jointly improve accuracy and efficiency. Specifically, the Top-1 accuracy is increased by 3.3% to 73.91% in contrast with that of the depth-wise convolution. Meanwhile, the number of parameters and floating-point operations are reduced by 29.02% and 30.77%, respectively, compared with the standard convolution.

Convolutional Memory Blocks for Depth Data Representation Learning

Depth Map Inpainting Using a Fully Convolutional Network

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Structure-Attentioned Memory Network for Monocular Depth Estimation

Depth Inference with Convolutional Neural Network.

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

CNN with large memory layers

Learning Multiviewpoint Context-Aware Representation for RGB-D Scene Classification

Channel-Modulated Multibranch Convolutional Neural Network

MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimation

Learning Depth Estimation from Memory Infusing Monocular Cues: A Generalization Prediction Approach

Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completion

CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability

Temporally Consistent Depth Prediction with Flow-Guided Memory Units

A Weight-Shared Dual-Branch Convolutional Neural Network For Unsupervised Dense Depth Prediction And Camera Motion Estimation

Squeeze-and-Remember Block

Learning Guided Convolutional Network for Depth Completion

Depth Estimation with Convolutional Conditional Random Field Network

Depth Pooling Based Large-scale 3D Action Recognition with Convolutional Neural Networks

Learning an Efficient Multimodal Depth Completion Model

Self-supervised Monocular Depth Estimation Based on Combining Convolution and Multilayer Perceptron