MCMS: Multi-Category Information and Multi-Scale Stripe Attention for Blind Motion Deblurring

Nianzu Qiao,Lamei Di,Changyin Sun

2024-05-02

Abstract:Deep learning-based motion deblurring techniques have advanced significantly in recent years. This class of techniques, however, does not carefully examine the inherent flaws in blurry images. For instance, low edge and structural information are traits of blurry images. The high-frequency component of blurry images is edge information, and the low-frequency component is structure information. A blind motion deblurring network (MCMS) based on multi-category information and multi-scale stripe attention mechanism is proposed. Given the respective characteristics of the high-frequency and low-frequency components, a three-stage encoder-decoder model is designed. Specifically, the first stage focuses on extracting the features of the high-frequency component, the second stage concentrates on extracting the features of the low-frequency component, and the third stage integrates the extracted low-frequency component features, the extracted high-frequency component features, and the original blurred image in order to recover the final clear image. As a result, the model effectively improves motion deblurring by fusing the edge information of the high-frequency component and the structural information of the low-frequency component. In addition, a grouped feature fusion technique is developed so as to achieve richer, more three-dimensional and comprehensive utilization of various types of features at a deep level. Next, a multi-scale stripe attention mechanism (MSSA) is designed, which effectively combines the anisotropy and multi-scale information of the image, a move that significantly enhances the capability of the deep model in feature representation. Large-scale comparative studies on various datasets show that the strategy in this paper works better than the recently published measures.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the motion - blurred image deblurring techniques, the existing methods do not fully consider the inherent problems in the blurred images, especially the separation and utilization of low - frequency and high - frequency information. Specifically:

1. **Separation of low - frequency and high - frequency information**: Blurred images usually have the characteristics of low - edge and structural information. High - frequency components mainly contain edge information, while low - frequency components mainly contain structural information. However, the existing deblurring techniques often ignore the detailed processing of this information, resulting in low - quality restored images.

2. **Utilization of multi - scale information**: The existing deblurring techniques are insufficient in dealing with the multi - scale information of images and cannot effectively combine the anisotropic and multi - scale information of images, thus affecting the ability of feature representation.

3. **Insufficient feature fusion**: Although the existing deblurring networks can extract image features, they do not do in - depth work in feature fusion and cannot fully utilize various types of feature information.

To solve these problems, the paper proposes a blind motion deblurring network (MCMS) based on multi - category information and multi - scale strip attention mechanism. This network improves the existing deblurring techniques in the following ways:

- **Three - stage encoder - decoder model**: The first stage focuses on extracting the features of high - frequency components, the second stage focuses on extracting the features of low - frequency components, and the third stage fuses the extracted low - frequency and high - frequency features with the original blurred image to restore the final clear image.

- **Multi - scale strip attention mechanism (MSSA)**: This mechanism effectively combines the anisotropic and multi - scale information of images and significantly enhances the ability of the deep model in feature representation.

- **Grouped feature fusion strategy**: Through the grouped feature fusion strategy, a richer, more three - dimensional and more comprehensive utilization of various types of feature information is achieved.

Through these improvements, the experimental results of MCMS on multiple datasets show that its deblurring effect is better than the existing state - of - the - art methods.