Abstract:In recent years, computer vision has witnessed remarkable advancements in image classification, specifically in the domains of fully convolutional neural networks (FCNs) and self-attention mechanisms. Nevertheless, both approaches exhibit certain limitations. FCNs tend to prioritize local information, potentially overlooking crucial global contexts, whereas self-attention mechanisms are computationally intensive despite their adaptability. In order to surmount these challenges, this paper proposes cross-and-diagonal networks (CDNet), innovative network architecture that adeptly captures global information in images while preserving local details in a more computationally efficient manner. CDNet achieves this by establishing long-range relationships between pixels within an image, enabling the indirect acquisition of contextual information. This inventive indirect self-attention mechanism significantly enhances the network's capacity. In CDNet, a new attention mechanism named "cross and diagonal attention" is proposed. This mechanism adopts an indirect approach by integrating two distinct components, cross attention and diagonal attention. By computing attention in different directions, specifically vertical and diagonal, CDNet effectively establishes remote dependencies among pixels, resulting in improved performance in image classification tasks. Experimental results highlight several advantages of CDNet. Firstly, it introduces an indirect self-attention mechanism that can be effortlessly integrated as a module into any convolutional neural network (CNN). Additionally, the computational cost of the self-attention mechanism has been effectively reduced, resulting in improved overall computational efficiency. Lastly, CDNet attains state-of-the-art performance on three benchmark datasets for similar types of image classification networks. In essence, CDNet addresses the constraints of conventional approaches and provides an efficient and effective solution for capturing global context in image classification tasks.

Cross-Level: A Practical Strategy for Convolutional Neural Networks Based Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Cross Convolutional Neural Networks

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

Convolutional Networks with Cross-Layer Neurons for Image Recognition

Advances in Convolutional Neural Networks

A Novel Deep Learning Network Architecture with Cross-Layer Neurons

The Treasure beneath Convolutional Layers: Cross-convolutional-layer Pooling for Image Classification

Delving into Fully Convolutional Networks Activations for Visual Recognition.

The Treasure Beneath Convolutional Layers: Cross-Convolutional-Iayer Pooling For Image Classification

Cross-convolutional-layer Pooling for Generic Visual Recognition.

Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification

Cross-layer Navigation Convolutional Neural Network for Fine-grained Visual Classification

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

Image Target Recognition Based on Improved Convolutional Neural Network

Fine-Grained Image Classification Based on Cross-Attention Network

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Optimization of CNN through Novel Training Strategy for Visual Classification Problems

On the Large-Scale Transferability of Convolutional Neural Networks.