Abstract:Thin-section magnetic resonance imaging (MRI) can provide higher resolution anatomical structures and more precise clinical information than thick-section images. However, thin-section MRI is not always available due to the imaging cost issue. In multicenter retrospective studies, a large number of data are often in thick-section manner with different section thickness. The lack of thin-section data and the difference in section thickness bring considerable difficulties in the study based on the image big data. In this article, we introduce DeepVolume, a two-step deep learning architecture to address the challenge of accurate thin-section MR image reconstruction. The first stage is the brain structure-aware network, in which the thick-section MR images in axial and sagittal planes are fused by a multitask 3-D U-net with prior knowledge of brain volume segmentation, which encourages the reconstruction result to have correct brain structure. The second stage is the spatial connection-aware network, in which the preliminary reconstruction results are adjusted slice-by-slice by a recurrent convolutional network embedding convolutional long short-term memory (LSTM) block, which enhances the precision of the reconstruction by utilizing the previously unassessed sagittal information. We used 305 paired brain MRI samples with thickness of 1.0 mm and 6.5 mm in this article. Extensive experiments illustrate that DeepVolume can produce the state-of-the-art reconstruction results by embedding more anatomical knowledge. Furthermore, considering DeepVolume as an intermediate step, the practical and clinical value of our method is validated by applying the brain volume estimation and voxel-based morphometry. The results show that DeepVolume can provide much more reliable brain volume estimation in the normalized space based on the thick-section MR images compared with the traditional solutions.

Brain Atlas Fusion from High-Thickness Diagnostic Magnetic Resonance Images by Learning-Based Super-Resolution.

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Deep Fusion Network Based Sparse View CT Reconstructions for Clinical Diagnostic Scanners

3D MRI Image Super-Resolution for Brain Combining Rigid and Large Diffeomorphic Registration

Brain MRI Super-Resolution Using Coupled-Projection Residual Network

Super-Resolution Reconstruction of Fetal Brain MRI with Prior Anatomical Knowledge

Brain MR Image Super-resolution Using 3D Feature Attention Network

DeepVolume: Brain Structure and Spatial Connection-Aware Network for Brain MRI Super-Resolution

High-Quality Fusion and Visualization for MR-PET Brain Tumor Images via Multi-Dimensional Features

Brain MRI Super-resolution Reconstruction Using a Multi-level and Parallel Conv-Deconv Network

DL-MRI: A Unified Framework of Deep Learning-Based MRI Super Resolution

Super-Resolution of Brain MRI Images using Overcomplete Dictionaries and Nonlocal Similarity

Neural Multi-Atlas Label Fusion: Application to Cardiac MR Images

Cross-Modality Reference and Feature Mutual-Projection for 3D Brain MRI Image Super-Resolution

Brain MR Atlas Construction Using Symmetric Deep Neural Inpainting

Hybrid Feature Fusion Neural Network Integrating Transformer for DCE-MRI Super Resolution

Deep Fusion Net for Multi-atlas Segmentation: Application to Cardiac MR Images

Integrated 3d flow-based multi-atlas brain structure segmentation.

3D Cross-Scale Feature Transformer Network for Brain Mr Image Super-Resolution

Multi-Atlas Based Segmentation of Brainstem Nuclei from MR Images by Deep Hyper-Graph Learning

Accurate super-resolution low-field brain MRI