Abstract:Since Deep Convolutional Neural Networks (DCNNs) and Vision Transformer perform well in learning generalizable image priors from large-scale data, these models have been widely used in image denoising tasks. However, vanilla DCNNs and Transformer suffer from two problems. First, the vanilla DCNNs and Transformer only accumulate the output along the channel axis, ignoring the internal relationship among channels. This results in the severely inadequate color structure representation retrieved from color images. Secondly, the DCNNs or Transformer-based image denoising models usually have a large number of parameters, high computational complexity, and slow inference speed. To resolve these issues, this paper proposes a highly-efficient Quaternion Transformer (QFormer) for image denoising. Specifically, the proposed Quaternion Transformer Block (QTB) simplifies the typical Transformer from a multi-branch structure to an elaborately sequential structure mainly with quaternion transformations, to alternately capture both long-range dependencies and local contextual features with color structure information. Furthermore, the proposed QTB can also avoid considerable element-wise multiplications of computing the self-attention matrices. Thus, our QTB can significantly reduce the computational complexity and its sequential structure can further improve the practical inference speed. Comprehensive experiments demonstrate that the proposed QFormer produces state-of-the-art results in both denoising performance and efficiency. We hope that our work will encourage further research to explore the Quaternion Transformer architecture for image denoising tasks.

Color Random Valued Impulse Noise Removal Based on Quaternion Convolutional Attention Denoising Network

QCGFNet: A Lightweight Color Image Denoising Network

Spatial-Adaptive Network for Single Image Denoising

Color Image Denoising Using Reduced Biquaternion U-Network

Image Mixed Denoising Using Quaternion-Based Non-Local Low Rank and Total Variation

Color Image Denoising Using Quaternion Adaptive Non-Local Coupled Means.

Denoising Color Images Based on Local Orientation Estimation and CNN Classifier

Removal of Impulse Noise in Color Images Based on Convolutional Neural Network

Quaternion-Based Impulse Noise Removal from Color Video Sequences

QCNN-H: Single-Image Dehazing Using Quaternion Neural Networks

Quaternion Non-local Total Variation for Color Image Denoising.

Two-stage Quaternion Switching Vector Filter for Color Impulse Noise Removal

Quaternion-based color image filtering for impulsive noise suppression

Mixed noise removal for color images using quaternion representation

An Effective Vector Filter for Impulse Noise Reduction Based on Adaptive Quaternion Color Distance Mechanism

A quaternion-based switching filter for colour image denoising.

Quaternion Singular Value Decomposition Approach to Color Image De-Noising

QFormer: an Efficient Quaternion Transformer for Image Denoising

TRQ3DNet: A 3D Quasi-Recurrent and Transformer Based Network for Hyperspectral Image Denoising

Color Impulsive Noise Removal Based on Quaternion Representation and Directional Vector Order-Statistics

DCANet: Dual Convolutional Neural Network with Attention for Image Blind Denoising