Abstract:In the realm of image deraining, traditional CNN-based deep learning deraining systems exhibit efficient expression of local features and strong generalization capabilities. However, their limited local receptive fields and independence from input content hinder their ability to model global features, rendering them less effective in mitigating complex and dynamic long rain streak scenarios. On the other hand, deraining systems based on the Transformer architecture possess robust global feature aggregation capabilities. Yet, their computational complexity increases quadratically with the expansion of the image spatial scale, making them less suitable for high-quality image deraining tasks. However, for ill-posed problems like image deraining, the precise representation of both local and global features has become increasingly pivotal to addressing the multifaceted challenges of rain streak removal. Consequently, we introduce an innovative solution, the CNN and Gated Multi Axial-Sparse Transformer Feature Fusion Network, referred to as CGMAformer. This approach optimizes both architectural paradigms jointly, effectively harnessing their respective strengths for image deraining. Specifically, in the local feature extraction phase based on CNN, we employ the Degradation-aware Mixture of Experts Feature Compensator (DMEFC) for adaptive representation of local spatial rain streak features. In the global feature extraction phase based on the Transformer, we introduce a dual-branch adaptive Gated Multi-Axis Sparse Transformer (GAST) attention mechanism to complement global background spatial features in rainy images. This approach ensures the preservation of global feature integrity while effectively reducing model complexity. Ultimately, through a feature fusion network, we fully exploit the local characteristics of CNN and the self-attention-based global aggregation capabilities of the Transformer for efficient image deraining.

Gradient aggregation based fine-grained image retrieval : A unified viewpoint for CNN and Transformer

Aggregating Hierarchical Binary Activations for Image Retrieval

Exploring Geometric Information in CNN for Image Retrieval.

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

TransFG:A Cross-view Geo-Localization of Satellite and UAVs Imagery Pipeline Using Transformer-Based Feature Aggregation and Gradient Guidance

Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers

TransFG: A Cross-View Geo-Localization of Satellite and UAVs Imagery Pipeline Using Transformer-Based Feature Aggregation and Gradient Guidance

Hybrid Granularities Transformer for Fine-Grained Image Recognition

FET-FGVC: Feature-enhanced transformer for fine-grained visual classification

Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNN

Hierarchical Feature Aggregation based on Transformer for Image-text Matching

Adversarial and Isotropic Gradient Augmentation for Image Retrieval with Text Feedback

TransGA-Net: Integration Transformer With Gradient-Aware Feature Aggregation for Accurate Cloud Detection in Remote Sensing Imagery

CGMAformer: CNN and gated multi axial-sparse transformer feature fusion network for image deraining

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

CTA-Net: A CNN-Transformer Aggregation Network for Improving Multi-Scale Feature Extraction

SwinFG: A fine-grained recognition scheme based on swin transformer

Fine-grained Image Retrieval by Combining Attention Mechanism and Context Information

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features

Gradient rectified parameter unit of the fully connected layer in convolutional neural networks

CFGN: A Lightweight Context Feature Guided Network for Image Super-Resolution