Abstract:In recent years, computer vision has witnessed remarkable advancements in image classification, specifically in the domains of fully convolutional neural networks (FCNs) and self-attention mechanisms. Nevertheless, both approaches exhibit certain limitations. FCNs tend to prioritize local information, potentially overlooking crucial global contexts, whereas self-attention mechanisms are computationally intensive despite their adaptability. In order to surmount these challenges, this paper proposes cross-and-diagonal networks (CDNet), innovative network architecture that adeptly captures global information in images while preserving local details in a more computationally efficient manner. CDNet achieves this by establishing long-range relationships between pixels within an image, enabling the indirect acquisition of contextual information. This inventive indirect self-attention mechanism significantly enhances the network's capacity. In CDNet, a new attention mechanism named "cross and diagonal attention" is proposed. This mechanism adopts an indirect approach by integrating two distinct components, cross attention and diagonal attention. By computing attention in different directions, specifically vertical and diagonal, CDNet effectively establishes remote dependencies among pixels, resulting in improved performance in image classification tasks. Experimental results highlight several advantages of CDNet. Firstly, it introduces an indirect self-attention mechanism that can be effortlessly integrated as a module into any convolutional neural network (CNN). Additionally, the computational cost of the self-attention mechanism has been effectively reduced, resulting in improved overall computational efficiency. Lastly, CDNet attains state-of-the-art performance on three benchmark datasets for similar types of image classification networks. In essence, CDNet addresses the constraints of conventional approaches and provides an efficient and effective solution for capturing global context in image classification tasks.

Cross Convolutional Neural Networks

Cross-Level: A Practical Strategy for Convolutional Neural Networks Based Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Image Classification Based on Convolutional Neural Networks with Cross-Level Strategy

Convolutional Networks with Cross-Layer Neurons for Image Recognition

A Novel Deep Learning Network Architecture with Cross-Layer Neurons

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

The Treasure beneath Convolutional Layers: Cross-convolutional-layer Pooling for Image Classification

ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions

Image Target Recognition Based on Improved Convolutional Neural Network

CDTNet: Improved Image Classification Method Using Standard, Dilated and Transposed Convolutions

Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification

Delving into Fully Convolutional Networks Activations for Visual Recognition.

Cropout: A General Mechanism for Reducing Overfitting on Convolutional Neural Networks

Accelerating Convolutional Neural Networks by Removing Interspatial and Interkernel Redundancies.

Cross-layer Navigation Convolutional Neural Network for Fine-grained Visual Classification

Cross-model Convolutional Neural Network for Multiple Modality Data Representation.

DualConv: Dual Convolutional Kernels for Lightweight Deep Neural Networks

The Treasure Beneath Convolutional Layers: Cross-Convolutional-Iayer Pooling For Image Classification

Accelerating Convolutional Neural Networks Using Fine-Tuned Backpropagation Progress

Cross-Part Learning for Fine-Grained Image Classification