Abstract:Hyperspectral (HS) image classification has become an important research area. Although previous work on HS image classification has achieved impressive results, finding a proper balance between extracting spatial–spectral information and capturing band similarities remains a challenge. To address this problem, we designed some efficient modules and constructed hybrid covariance attention and cross-layer fusion transformer network (CACFTNet), which efficiently models the extraction of spatial–spectral information and band similarity. First, our approach combines local and global perspectives to process the desired feature information. We introduce the dual-branch feature processing (DBFP) module, which can model the desired spatial–spectral information and band similarity. Second, we design the dual-branch feature fusion (DBFF) module, which combines a convolutional neural network (CNN) and a transformer to catch spatial–spectral information at different scales and fuse them effectively. To further process the features, we construct the unparameterized covariance attention (UPCA) module, which utilizes the covariance matrix to capture the correlation between different spectral bands. This allows the network to concentrate on bands that are more useful for classification tasks. In addition, we designed a hybrid activation function (HAF) that maps the channel values to specific ranges and emphasizes the extent to which the correlation varies between different bands. Finally, in order to incorporate important information from different layers, we propose the cross-layer adaptive attention fusion (CAAF) module, which fully fuses information between layers and enriches the overall information representation. We evaluate our proposed model on three well-known public datasets and demonstrate its superiority over existing approaches.

Transfer Classification for Distinct Manifestations with Shared Information

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

Collaborative Transfer Network for Multi-Classification of Breast Cancer Histopathological Images

On the Large-Scale Transferability of Convolutional Neural Networks.

Hybrid Granularities Transformer for Fine-Grained Image Recognition

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

CTransCNN: Combining transformer and CNN in multilabel medical image classification

MTFFN: Multimodal Transfer Feature Fusion Network for Hyperspectral Image Classification

Joint spectral-spatial hyperspectral classification based on transfer learning (SSTL) from red-green-blue (RGB) images

Masked Topology Convolutional Network for Classification and Segmentation of Remote Sensing Images

Deep Sparse Informative Transfer SoftMax for Cross-Domain Image Classification.

Multi-directional guidance network for fine-grained visual classification

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

Classification of COVID-19 in CT Scans using Multi-Source Transfer Learning

Midcn: A Multiple Instance Deep Convolutional Network For Image Classification

CACFTNet: A Hybrid Cov-Attention and Cross-Layer Fusion Transformer Network for Hyperspectral Image Classification

ClusterFormer: Clustering As A Universal Visual Learner

A Vision Enhancement and Feature Fusion Multiscale Detection Network

Group visualization of class-discriminative features

Learning Deep Classifiers With Deep Features