Abstract:A deep framework for the accelerated multislice magnetic resonance imaging (MRI) reconstruction is proposed here. It exploits the non‐local interslice correlation information between adjacent slices in MRI image sequences to reconstruct high‐quality undersampled MRI images. A novel texture Transformer architecture for MRI reconstruction is designed. Such a framework enables united feature learning across target slice and adjacent slices, which encourages the exploration of deep features and transferring of accurate texture features across adjacent slices by the attention mechanism. The proposed multislice texture transformer network can be constructed in a cross‐scale way. It enables to recovery textures of MRI images via different levels, and enables to reserve more details in MRI reconstruction. Magnetic resonance imaging (MRI) is a non‐interposition imaging technique that provides rich anatomical and physiological information. Yet it is limited by the long imaging time. Recently, deep neural networks have shown potential to significantly accelerate MRI. However, most of these approaches ignore the correlation between adjacent slices in MRI image sequences. In addition, the existing deep learning‐based methods for MRI are mainly based on convolutional neural networks (CNNs). They fail to capture long‐distance dependencies due to the small receptive field. Inspired by the feature similarity in adjacent slices and impressive performance of Transformer for exploiting the long‐distance dependencies, a novel multislice texture transformer network is presented for undersampled MRI reconstruction (TTMRI). Specifically, the proposed TTMRI is consisted of four modules, namely the texture extraction, correlation calculation, texture transfer and texture synthesis. It takes three adjacent slices as inputs, in which the middle one is the target image to be reconstructed, and the other two are auxiliary images. The multiscale features are extracted by the texture extraction module and their inter‐dependencies are calculated by the correlation calculation module, respectively. Then the relevant features are transferred by the texture transfer module and fused by the texture synthesis module. By considering inter‐slice correlations and leveraging the Transformer architecture, the joint feature learning across target and adjacent slices are encouraged. Moreover, TTMRI can be stacked with multiple layers to recover more texture information at different levels. Extensive experiments demonstrate that the proposed TTMRI outperforms other state‐of‐the‐art methods in both quantitative and qualitative evaluationsions.

Multi-scale Tokens-Aware Transformer Network for Multi-region and Multi-sequence MR-to-CT Synthesis in A Single Model

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Multi-scale Transformer Network with Edge-aware Pre-training for Cross-Modality MR Image Synthesis

CT synthesis from MRI with an improved multi-scale learning network

SLMT-Net: A Self-supervised Learning Based Multi-scale Transformer Network for Cross-Modality MR Image Synthesis

Enhancing CT Image synthesis from multi-modal MRI data based on a multi-task neural network framework

Multi-Modal Transformer for Accelerated MR Imaging

MT-SCnet: multi-scale token divided and spatial-channel fusion transformer network for microscopic hyperspectral image segmentation

Multimodal Transformer for Accelerated MR Imaging

CT synthesis from multi-sequence MRI using adaptive fusion network

MMMViT: Multiscale multimodal vision transformer for brain tumor segmentation with missing modalities

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

CT synthesis from MR in the pelvic area using Residual Transformer Conditional GAN

MS-TCNet: An effective Transformer–CNN combined network using multi-scale feature learning for 3D medical image segmentation

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

Multi-scale Deformable Transformer for Multi-Contrast Knee MRI Super-Resolution.

Multi-sequence MR Image-Based Synthetic CT Generation Using a Generative Adversarial Network for Head and Neck MRI-only Radiotherapy

TTMRI: Multislice texture transformer network for undersampled MRI reconstruction

Magnetic Resonance Image Processing Transformer for General Reconstruction