Convolutional Neural Networks learn compact local image descriptors

Christian Osendorfer,Justin Bayer,Patrick van der Smagt

DOI: https://doi.org/10.48550/arXiv.1304.7948

2013-06-03

Abstract:A standard deep convolutional neural network paired with a suitable loss function learns compact local image descriptors that perform comparably to state-of-the art approaches.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

Learning Local Feature Descriptors with Quadruplet Ranking Loss

Dalong Zhang,Lei Zhao,Duanqing Xu,Dongming Lu

DOI: https://doi.org/10.1007/978-981-10-7299-4_17

2017-01-01

Abstract:In this work, we propose a novel deep convolutional neural network (CNN) with quadruplet ranking loss to learn local feature descriptors. The proposed model receives quadruplets of two corresponding patches and two non-corresponding patches, and then outputs features measured by L-2 norm with dimension (256d) close to that of SIFT, which thus can be easily applied to practical vision tasks by plug-in replacing SIFT-like features. Moreover, the proposed model mitigates the problem that the margin separating corresponding and non-corresponding pairs varies with samples caused by commonly used triplet loss, and improves the capacity of utilizing the limited training data. Experiments show that our model outperforms some state-of-the-art methods like TN-TG and PN-Net.
CDbin: Compact Discriminative Binary Descriptor Learned With Efficient Neural Network

Shiliang Zhang,Jianming Ye,Y. Rui,Tiejun Huang

DOI: https://doi.org/10.1109/TCSVT.2019.2896095

2020-03-01

Abstract:As an important computer vision task, image matching requires efficient and discriminative local descriptors. Most of the existing descriptors like SIFT and ORB are hand-crafted; therefore it is necessary to study more optimized descriptors through end-to-end learning. This paper proposes the compact binary descriptors learned with a lightweight Convolutional Neural Network (CNN), which is efficient for training and testing. Specifically, we propose a CNN with no larger than five layers for descriptor learning. The resulting descriptors, i.e., Compact Discriminative binary descriptors (CDbin) are optimized with four complementary loss functions, i.e., 1) triplet loss to ensure the discriminative power; 2) quantization loss to decrease the quantization error; 3) correlation loss to ensure the feature compactness; and 4) even-distribution loss to enrich the embedded information. The extensive experiments on two image patch datasets and three image retrieval datasets show that the CDbin exhibits competitive performance compared with the existing descriptors. For example, the 64-bit CDbin substantially outperforms the 256-bit ORB and 1024-bit SIFT on Hpatches dataset. Although generated by a shallow CNN, CDbin also outperforms several recent deep descriptors.

Computer Science
Advances in Convolutional Neural Networks

Wen Xu,Jing He,Yanfeng Shu,Hui Zheng

DOI: https://doi.org/10.5772/intechopen.93512

2020-01-01

Abstract:Deep Learning, also known as deep representation learning, has dramatically improved the performances on a variety of learning tasks and achieved tremendous successes in the past few years. Specifically, artificial neural networks are mainly studied, which mainly include Multilayer Perceptrons (MLPs), Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). Among these networks, CNNs got the most attention due to the kernel methods with the weight sharing mechanism, and achieved state-of-the-art in many domains, especially computer vision. In this research, we conduct a comprehensive survey related to the recent improvements in CNNs, and we demonstrate these advances from the low level to the high level, including the convolution operations, convolutional layers, architecture design, loss functions, and advanced applications.
Research on Image Classification Method of Features of Combinatorial Convolution

Chao Wu,Yaqian Li,Zhibiao Zhao,Bin Liu

DOI: https://doi.org/10.1007/s12652-019-01433-9

IF: 3.662

2019-01-01

Journal of Ambient Intelligence and Humanized Computing

Abstract:In image classification, shallow convolutional features and deep convolutional features are not fully utilized by many network frameworks. To solve this problem, we propose a combinatorial convolutional network (CCNet) that integrates convolutional features of all levels. According to its own structure, the convolutional features of shallow, medium, and deep levels are extracted. These features are combined by weighted concatenation and convolutional fusion, and the coefficients of each channel of final combination feature are again weighted to improve the identification degree of features. CCNet can improve the single case where most network only add or concatenate shallow and deep features, so that the network can achieve lower classification error rate while generating low-dimensional features. Extensive experiments are performed on CIFAR-10 and CIFAR-100 respectively. The experimental results show that the low-dimensional image feature vectors generated by CCNet effectively reduce the classification error rate when the number of convolutional layers does not exceed 100 layers.
Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions

Vijay Kumar B G,Gustavo Carneiro,Ian Reid

DOI: https://doi.org/10.48550/arXiv.1512.09272

2016-08-01

Abstract:Recent innovations in training deep convolutional neural network (ConvNet) models have motivated the design of new methods to automatically learn local image descriptors. The latest deep ConvNets proposed for this task consist of a siamese network that is trained by penalising misclassification of pairs of local image patches. Current results from machine learning show that replacing this siamese by a triplet network can improve the classification accuracy in several problems, but this has yet to be demonstrated for local image descriptor learning. Moreover, current siamese and triplet networks have been trained with stochastic gradient descent that computes the gradient from individual pairs or triplets of local image patches, which can make them prone to overfitting. In this paper, we first propose the use of triplet networks for the problem of local image descriptor learning. Furthermore, we also propose the use of a global loss that minimises the overall classification error in the training set, which can improve the generalisation capability of the model. Using the UBC benchmark dataset for comparing local image descriptors, we show that the triplet network produces a more accurate embedding than the siamese network in terms of the UBC dataset errors. Moreover, we also demonstrate that a combination of the triplet and global losses produces the best embedding in the field, using this triplet network. Finally, we also show that the use of the central-surround siamese network trained with the global loss produces the best result of the field on the UBC dataset. Pre-trained models are available online at <a class="link-external link-https" href="https://github.com/vijaykbg/deep-patchmatch" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition
Working hard to know your neighbor's margins: Local descriptor learning loss

Anastasiya Mishchuk,Dmytro Mishkin,Filip Radenovic,Jiri Matas

DOI: https://doi.org/10.48550/arXiv.1705.10872

2017-05-30

Computer Vision and Pattern Recognition

Abstract:We introduce a novel loss for learning local feature descriptors which is inspired by the Lowe's matching criterion for SIFT. We show that the proposed loss that maximizes the distance between the closest positive and closest negative patch in the batch is better than complex regularization methods; it works well for both shallow and deep convolution network architectures. Applying the novel loss to the L2Net CNN architecture results in a compact descriptor -- it has the same dimensionality as SIFT (128) that shows state-of-art performance in wide baseline stereo, patch verification and instance retrieval benchmarks. It is fast, computing a descriptor takes about 1 millisecond on a low-end GPU.
Learning Compact Binary Descriptors with Unsupervised Deep Neural Networks

Kevin Lin,Jiwen Lu,Chu-Song Chen,Jie Zhou

DOI: https://doi.org/10.1109/cvpr.2016.133

2016-01-01

Computer Vision and Pattern Recognition

Abstract:In this paper, we propose a new unsupervised deep learning approach called DeepBit to learn compact binary descriptor for efficient visual object matching. Unlike most existing binary descriptors which were designed with random projections or linear hash functions, we develop a deep neural network to learn binary descriptors in an unsupervised manner. We enforce three criterions on binary codes which are learned at the top layer of our network: 1) minimal loss quantization, 2) evenly distributed codes and 3) uncorrelated bits. Then, we learn the parameters of the networks with a back-propagation technique. Experimental results on three different visual analysis tasks including image matching, image retrieval, and object recognition clearly demonstrate the effectiveness of the proposed approach.
Unsupervised Deep Learning of Compact Binary Descriptors

Kevin Lin,Jiwen Lu,Chu-Song Chen,Jie Zhou,Ming-Ting Sun

DOI: https://doi.org/10.1109/tpami.2018.2833865

IF: 23.6

2019-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Binary descriptors have been widely used for efficient image matching and retrieval. However, most existing binary descriptors are designed with hand-craft sampling patterns or learned with label annotation provided by datasets. In this paper, we propose a new unsupervised deep learning approach, called DeepBit, to learn compact binary descriptor for efficient visual object matching. We enforce three criteria on binary descriptors which are learned at the top layer of the deep neural network: 1) minimal quantization loss, 2) evenly distributed codes and 3) transformation invariant bit. Then, we estimate the parameters of the network through the optimization of the proposed objectives with a back-propagation technique. Extensive experimental results on various visual recognition tasks demonstrate the effectiveness of the proposed approach. We further demonstrate our proposed approach can be realized on the simplified deep neural network, and enables efficient image matching and retrieval speed with very competitive accuracies.
Local Feature Descriptor Learning with Adaptive Siamese Network

Chong Huang,Qiong Liu,Yan-Ying Chen,Kwang-Ting,Cheng

DOI: https://doi.org/10.48550/arXiv.1706.05358

2017-06-17

Abstract:Although the recent progress in the deep neural network has led to the development of learnable local feature descriptors, there is no explicit answer for estimation of the necessary size of a neural network. Specifically, the local feature is represented in a low dimensional space, so the neural network should have more compact structure. The small networks required for local feature descriptor learning may be sensitive to initial conditions and learning parameters and more likely to become trapped in local minima. In order to address the above problem, we introduce an adaptive pruning Siamese Architecture based on neuron activation to learn local feature descriptors, making the network more computationally efficient with an improved recognition rate over more complex networks. Our experiments demonstrate that our learned local feature descriptors outperform the state-of-art methods in patch matching.

Machine Learning
Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detection

Davide Cozzolino,Giovanni Poggi,Luisa Verdoliva

DOI: https://doi.org/10.48550/arXiv.1703.04615

2017-03-15

Abstract:Local descriptors based on the image noise residual have proven extremely effective for a number of forensic applications, like forgery detection and localization. Nonetheless, motivated by promising results in computer vision, the focus of the research community is now shifting on deep learning. In this paper we show that a class of residual-based descriptors can be actually regarded as a simple constrained convolutional neural network (CNN). Then, by relaxing the constraints, and fine-tuning the net on a relatively small training set, we obtain a significant performance improvement with respect to the conventional detector.

Computer Vision and Pattern Recognition
Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Neeraj Kumar Singh,Nikhil R. Pal

DOI: https://doi.org/10.48550/arXiv.2311.08314

2023-11-14

Computer Vision and Pattern Recognition

Abstract:In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all challenges. Unfortunately, a common downside of these networks is their ''black-box'' character, which does not necessarily mirror the operation of biological neural systems. Some even have millions/billions of learnable (tunable) parameters, and their training demands extensive data and time. Here, we integrate the principles of biological neurons in certain layer(s) of CNNs. Specifically, we explore the use of neuro-science-inspired computational models of the Lateral Geniculate Nucleus (LGN) and simple cells of the primary visual cortex. By leveraging such models, we aim to extract image features to use as input to CNNs, hoping to enhance training efficiency and achieve better accuracy. We aspire to enable shallow networks with a Push-Pull Combination of Receptive Fields (PP-CORF) model of simple cells as the foundation layer of CNNs to enhance their learning process and performance. To achieve this, we propose a two-tower CNN, one shallow tower and the other as ResNet 18. Rather than extracting the features blindly, it seeks to mimic how the brain perceives and extracts features. The proposed system exhibits a noticeable improvement in the performance (on an average of $5\%-10\%$) on CIFAR-10, CIFAR-100, and ImageNet-100 datasets compared to ResNet-18. We also check the efficiency of only the Push-Pull tower of the network.
Object Level Deep Feature Pooling for Compact Image Representation

Konda Reddy Mopuri,R. Venkatesh Babu

DOI: https://doi.org/10.48550/arXiv.1504.06591

2015-04-25

Abstract:Convolutional Neural Network (CNN) features have been successfully employed in recent works as an image descriptor for various vision tasks. But the inability of the deep CNN features to exhibit invariance to geometric transformations and object compositions poses a great challenge for image search. In this work, we demonstrate the effectiveness of the objectness prior over the deep CNN features of image regions for obtaining an invariant image representation. The proposed approach represents the image as a vector of pooled CNN features describing the underlying objects. This representation provides robustness to spatial layout of the objects in the scene and achieves invariance to general geometric transformations, such as translation, rotation and scaling. The proposed approach also leads to a compact representation of the scene, making each image occupy a smaller memory footprint. Experiments show that the proposed representation achieves state of the art retrieval results on a set of challenging benchmark image datasets, while maintaining a compact representation.

Computer Vision and Pattern Recognition
Compression of Deep Neural Networks for Image Instance Retrieval

Vijay Chandrasekhar,Jie Lin,Qianli Liao,Olivier Morere,Antoine Veillard,Lingyu Duan,Tomaso Poggio

DOI: https://doi.org/10.1109/dcc.2017.93

2017-01-01

Abstract:Image instance retrieval is the problem of retrieving images from a database which contain the same object. Convolutional Neural Network (CNN) based descriptors are becoming the dominant approach for generating global image descriptors for the instance retrieval problem. One major drawback of CNN-based global descriptors is that uncompressed deep neural network models require hundreds of megabytes of storage making them inconvenient to deploy in mobile applications or in custom hardware. In this work, we study the problem of neural network model compression focusing on the image instance retrieval task. We study quantization, coding, pruning and weight sharing techniques for reducing model size for the instance retrieval problem. We provide extensive experimental results on the trade-off between retrieval performance and model size for different types of networks on several data sets providing the most comprehensive study on this topic. We compress models to the order of a few MBs: two orders of magnitude smaller than the uncompressed models while achieving negligible loss in retrieval performance1.
Deep Learning Using Isotroping, Laplacing, Eigenvalues Interpolative Binding, and Convolved Determinants with Normed Mapping for Large-Scale Image Retrieval

Khadija Kanwal,Khawaja Tehseen Ahmad,Rashid Khan,Naji Alhusaini,Li Jing

DOI: https://doi.org/10.3390/s21041139

2021-02-06

Abstract:Convolutional neural networks (CNN) are relational with grid-structures and spatial dependencies for two-dimensional images to exploit location adjacencies, color values, and hidden patterns. Convolutional neural networks use sparse connections at high-level sensitivity with layered connection complying indiscriminative disciplines with local spatial mapping footprints. This fact varies with architectural dependencies, insight inputs, number and types of layers and its fusion with derived signatures. This research focuses this gap by incorporating GoogLeNet, VGG-19, and ResNet-50 architectures with maximum response based Eigenvalues textured and convolutional Laplacian scaled object features with mapped colored channels to obtain the highest image retrieval rates over millions of images from versatile semantic groups and benchmarks. Time and computation efficient formulation of the presented model is a step forward in deep learning fusion and smart signature capsulation for innovative descriptor creation. Remarkable results on challenging benchmarks are presented with a thorough contextualization to provide insight CNN effects with anchor bindings. The presented method is tested on well-known datasets including ALOT (250), Corel-1000, Cifar-10, Corel-10000, Cifar-100, Oxford Buildings, FTVL Tropical Fruits, 17-Flowers, Fashion (15), Caltech-256, and reported outstanding performance. The presented work is compared with state-of-the-art methods and experimented over tiny, large, complex, overlay, texture, color, object, shape, mimicked, plain and occupied background, multiple objected foreground images, and marked significant accuracies.
Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Xian Wei,Yingjie Liu,Xuan Tang,Shui Yu,Mingsong Chen

DOI: https://doi.org/10.1109/TNNLS.2024.3453374

2024-09-18

Abstract:This work investigates the problem of efficiently learning discriminative low-dimensional (LD) representations of multiclass image objects. We propose a generic end-to-end approach that jointly optimizes sparse dictionary and convolutions for learning LOW-dimensional discriminative image representations, named SparConvLow, taking advantage of convolutional neural networks (CNNs), dictionary learning, and orthogonal projections. The whole learning process can be summarized as follows. First, a CNN module is employed to extract high-dimensional (HD) preliminary convolutional features. Second, to avoid the high computational cost of direct sparse coding on HD CNN features, we learn sparse representation (SR) over a task-driven dictionary in the space with the feature being orthogonally projected. We then exploit the discriminative projection on SR. The whole learning process is consistently treated as an end-to-end joint optimization problem of trace quotient maximization. The cost function is well-defined on the product of the CNN parameters space, the Stiefel manifold, the Oblique manifold, and the Grassmann manifold. By using the explicit gradient delivery, the cost function is optimized via a geometrical stochastic gradient descent (SGD) algorithm along with the chain rule and the backpropagation. The experimental results show that the proposed method can achieve a highly competitive performance with the state-of-the-art (SOTA) image classification, object categorization, and face recognition methods, under both supervised and semi-supervised settings. The code is available at https://github.com/MVPR-Group/SparConvLow.
Convolutional Networks with Cross-Layer Neurons for Image Recognition

Zeng Yu,Tianrui Li,Guangchun Luo,Hamido Fujita,Ning Yu,Yi Pan

DOI: https://doi.org/10.1016/j.ins.2017.12.045

IF: 8.1

2018-01-01

Information Sciences

Abstract:Very deep convolutional networks have recently achieved a series of breakthroughs on several challenging tasks such as the ImageNet or COCO competitions. However, it is difficult to train such deep neural networks. In this paper, we present a novel structure called cross-layer neurons architecture, which has the capability to train effective deeper neural networks. It utilizes cross-layer neurons to synthesize the information (features) learned from all the lower-level layers and send them to the higher-level layers through the cross-layer. Based on this novel architecture, we propose a new deep neural model termed Cross-Layer Neurons Networks (CLNN). It is shown that CLNN can relieve the problem of vanishing gradient. It is also shown that CLNN has the capability of improving the convergence rate of classification. Comparative experiments on several benchmark datasets (MNIST, CIFAR-10, CIFAR-100, SVHN and STL-10) clearly demonstrate that our proposed model is suitable for training deeper networks and can effectively improve the performance by utilizing cross-layer neurons.
LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Junyi Wang,Wentao Zhang,Jun Fu,Kechen Song,Qinggang Meng,Lin Zhu,Yuru Jin

DOI: https://doi.org/10.1109/tcds.2023.3311171

IF: 4.546

2024-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Deep convolutional neural networks (DCNNs) have made great contributions to the development of computer vision. Since the trained DCNN models require a large amount of computing and storage resources to achieve high performance, it is usually difficult to deploy them on resource-limited systems. To address this problem, we propose a novel local dense connectivity (LDC) module to generate feature maps from cheap convolution operations. The LDC module constructs hierarchical and locally dense connections within a single layer. This construction promotes the reuse of features in network layers. As a result, it leads to the generation of multi-scale feature maps and increases the receptive fields for each network layer. A basic architecture block called LDCBlock was designed based on the LDC module. By stacking this kind of block, we propose a kind of lightweight and efficient multi-scale residual network named LDCNet. Moreover, to model the interdependencies between the channels of the LDC module and enhance the informativeness of diversified features, we also design a sparse Squeeze-Excitation (SE) module, which has fewer parameters and computations. Finally, the experiments based on CIFAR datasets, ImageNet dataset and a defect detection dataset demonstrate that our LDCNet achieves competitive performance compared with the state-of-the-art models focusing on model compression.
Untangling Local and Global Deformations in Deep Convolutional Networks for Image Classification and Sliding Window Detection

George Papandreou,Iasonas Kokkinos,Pierre-André Savalle

DOI: https://doi.org/10.48550/arXiv.1412.0296

2014-11-30

Computer Vision and Pattern Recognition

Abstract:Deep Convolutional Neural Networks (DCNNs) commonly use generic `max-pooling' (MP) layers to extract deformation-invariant features, but we argue in favor of a more refined treatment. First, we introduce epitomic convolution as a building block alternative to the common convolution-MP cascade of DCNNs; while having identical complexity to MP, Epitomic Convolution allows for parameter sharing across different filters, resulting in faster convergence and better generalization. Second, we introduce a Multiple Instance Learning approach to explicitly accommodate global translation and scaling when training a DCNN exclusively with class labels. For this we rely on a `patchwork' data structure that efficiently lays out all image scales and positions as candidates to a DCNN. Factoring global and local deformations allows a DCNN to `focus its resources' on the treatment of non-rigid deformations and yields a substantial classification accuracy improvement. Third, further pursuing this idea, we develop an efficient DCNN sliding window object detector that employs explicit search over position, scale, and aspect ratio. We provide competitive image classification and localization results on the ImageNet dataset and object detection results on the Pascal VOC 2007 benchmark.
Decoupled Networks ( with Appendix )

Weiyang Liu,Zhen Liu,Zhiding Yu,Bo Dai,Rongmei Lin,Yisen Wang,James M. Rehg,Le Song

2018-01-01

Abstract:Inner product-based convolution has been a central component of convolutional neural networks (CNNs) and the key to learning visual representations. Inspired by the observation that CNN-learned features are naturally decoupled with the norm of features corresponding to the intra-class variation and the angle corresponding to the semantic difference, we propose a generic decoupled learning framework which models the intra-class variation and semantic difference independently. Specifically, we first reparametrize the inner product to a decoupled form and then generalize it to the decoupled convolution operator which serves as the building block of our decoupled networks. We present several effective instances of the decoupled convolution operator. Each decoupled operator is well motivated and has an intuitive geometric interpretation. Based on these decoupled operators, we further propose to directly learn the operator from data. Extensive experiments show that such decoupled reparameterization renders significant performance gain with easier convergence and stronger robustness.
Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networks

Reinhard Heckel,Paul Hand

DOI: https://doi.org/10.48550/arXiv.1810.03982

2019-02-23

Abstract:Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements. This success can be attributed in part to their ability to represent and generate natural images well. Contrary to classical tools such as wavelets, image-generating deep neural networks have a large number of parameters---typically a multiple of their output dimension---and need to be trained on large datasets. In this paper, we propose an untrained simple image model, called the deep decoder, which is a deep neural network that can generate natural images from very few weight parameters. The deep decoder has a simple architecture with no convolutions and fewer weight parameters than the output dimensionality. This underparameterization enables the deep decoder to compress images into a concise set of network weights, which we show is on par with wavelet-based thresholding. Further, underparameterization provides a barrier to overfitting, allowing the deep decoder to have state-of-the-art performance for denoising. The deep decoder is simple in the sense that each layer has an identical structure that consists of only one upsampling unit, pixel-wise linear combination of channels, ReLU activation, and channelwise normalization. This simplicity makes the network amenable to theoretical analysis, and it sheds light on the aspects of neural networks that enable them to form effective signal representations.

Computer Vision and Pattern Recognition,Machine Learning

Convolutional Neural Networks learn compact local image descriptors

Learning Local Feature Descriptors with Quadruplet Ranking Loss

CDbin: Compact Discriminative Binary Descriptor Learned With Efficient Neural Network

Advances in Convolutional Neural Networks

Research on Image Classification Method of Features of Combinatorial Convolution

Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions

Working hard to know your neighbor's margins: Local descriptor learning loss

Learning Compact Binary Descriptors with Unsupervised Deep Neural Networks

Unsupervised Deep Learning of Compact Binary Descriptors

Local Feature Descriptor Learning with Adaptive Siamese Network

Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detection

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Object Level Deep Feature Pooling for Compact Image Representation

Compression of Deep Neural Networks for Image Instance Retrieval

Deep Learning Using Isotroping, Laplacing, Eigenvalues Interpolative Binding, and Convolved Determinants with Normed Mapping for Large-Scale Image Retrieval

Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Convolutional Networks with Cross-Layer Neurons for Image Recognition

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Untangling Local and Global Deformations in Deep Convolutional Networks for Image Classification and Sliding Window Detection

Decoupled Networks ( with Appendix )

Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networks