Abstract:Magnetic resonance imaging (MRI) tasks often involve multiple contrasts. Recently, numerous deep learning-based multi-contrast MRI super-resolution (SR) and reconstruction methods have been proposed to explore the complementary information from the multi-contrast images. However, these methods either construct parameter-sharing networks or manually design fusion rules, failing to accurately model the correlations between multi-contrast images and lacking certain interpretations. In this paper, we propose a multi-contrast convolutional dictionary (MC-CDic) model under the guidance of the optimization algorithm with a well-designed data fidelity term. Specifically, we bulid an observation model for the multi-contrast MR images to explicitly model the multi-contrast images as common features and unique features. In this way, only the useful information in the reference image can be transferred to the target image, while the inconsistent information will be ignored. We employ the proximal gradient algorithm to optimize the model and unroll the iterative steps into a deep CDic model. Especially, the proximal operators are replaced by learnable ResNet. In addition, multi-scale dictionaries are introduced to further improve the model performance. We test our MC-CDic model on multi-contrast MRI SR and reconstruction tasks. Experimental results demonstrate the superior performance of the proposed MC-CDic model against existing SOTA methods. Code is available at <a class="link-external link-https" href="https://github.com/lpcccc-cv/MC-CDic" rel="external noopener nofollow">this https URL</a>.

A Deep Dictionary Model To Preserve And Disentangle Key Features In A Signal

Double Sparse Dictionary Learning for Image Super Resolution

Deep Network for Image Super-Resolution with a Dictionary Learning Layer

Image super-resolution reconstruction based on deep dictionary learning and A+

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Super resolution of single depth image based on multi-dictionary learning with edge feature regularization

Depth Map Super-Resolution Based on Joint Dictionary Learning

Deep Networks for Image and Video Super-Resolution

Undersampled Dynamic MRI Reconstruction by Double Sparse Spatiotemporal Dictionary.

A Sparse Representation Based Super-Resolution Image Reconstruction Scheme Utilizing Dual Dictionaries

Deep Unfolding Convolutional Dictionary Model for Multi-Contrast MRI Super-resolution and Reconstruction

Single Image Super-Resolution Using Incoherent Sub-Dictionaries Learning

Single image super resolution based on adaptive multi-dictionary learning

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Multi-scale Dictionary for Single Image Super-Resolution

Image Super-Resolution Via Dual-Dictionary Learning And Sparse Representation

Dictionary learning based on structural self-similarity and convolution neural network

Deep Boosting: Joint Feature Selection and Analysis Dictionary Learning in Hierarchy

Receptive Field Size Versus Model Depth For Single Image Super-Resolution

Image Super-Resolution Reconstruction Model Based on Multi-Feature Fusion

A Single Super-Resolution Method Via Deep Cascade Network