Abstract:Deep convolution neural networks (DCNNs) in deep learning have been widely used in semantic segmentation. However, the filters of most regular convolutions in DCNNs are spatially invariant to local transformations, which reduces localization accuracy and hinders the improvement of semantic segmentation. Dynamic convolution with pixel-level filters can enhance the localization accuracy through its region-awareness, but these are sensitive to objects with large-scale variations in semantic segmentation. To simultaneously address the low localization accuracy and objects with large-scale variations, we propose a filter-varying atrous convolution (FAC) to efficiently enlarge the per-pixel receptive fields pertaining to various objects. FAC mainly consists of a conditional-filter-generating network (CFGN) and a dynamic local filtering operation (DLFO). In the CFGN, a class probability map is used to generate the corresponding filters, making the FAC genuinely dynamic. In the DLFO, by replacing the sliding convolution operation one by one with a one-time dot product operation, the efficiency of the algorithm is greatly improved. Also, a dense scale module (DSM) is constructed to generate denser scales and larger receptive fields for exploring long-range contextual information. Finally, a dense-scale dynamic network (DsDNet) simultaneously enhances the localization accuracy and reduces the effect of large-scale variations of the object, by assigning FAC to different spatial locations at dense scales. In addition, to accelerate network convergence and improve segmentation accuracy, our network employs two pixel-wise cross-entropy loss functions. One is between the Backbone and DSM, and the other is at the network's end. Extensive experiments on Cityscapes, PASCAL VOC 2012, and ADE20K datasets verify that the performance of our DsDNet is superior to the non-dynamic and multi-scale convolution neural networks.

Learning Scalable Dynamic Filter in Convolutional Networks.

Decoupled Dynamic Filter Networks

Dynamic Filtering with Large Sampling Field for ConvNets

Dynamic Sampling Convolutional Neural Networks.

Learning Lightweight Dynamic Kernels With Attention Inside via Local–Global Context Fusion

An Efficient Low-Complexity Convolutional Neural Network Filter

As large as it gets: Learning infinitely large Filters via Neural Implicit Functions in the Fourier Domain

Training Compact CNNs for Image Classification Using Dynamic-coded Filter Fusion

Dynamic Multi-Scale Convolutional Neural Network for Time Series Classification.

Efficient Higher-order Convolution for Small Kernels in Deep Learning

A Convolutional Neural Network-Based Low Complexity Filter

Dense-scale Dynamic Network with Filter-Varying Atrous Convolution for Semantic Segmentation

Learning Versatile Convolution Filters for Efficient Visual Recognition

When Sparsity Meets Dynamic Convolution

A Novel GPU-Based Efficient Approach for Convolutional Neural Networks with Small Filters

A Reconfigurable Framework for Neural Network-based Video In-loop Filtering

Dynamic CNN Accelerator Supporting Efficient Filter Generator with Kernel Enhancement and Online Channel Pruning

Learning Versatile Filters for Efficient Convolutional Neural Networks.

Importance-Aware Filter Selection for Convolutional Neural Network Acceleration

Bi-volution: A Static and Dynamic Coupled Filter

Learning Filter Scale and Orientation In CNNs