Matrix Completion-Informed Deep Unfolded Equilibrium Models for Self-Supervised k-Space Interpolation in MRI

Chen Luo,Huayu Wang,Taofeng Xie,Qiyu Jin,Guoqing Chen,Zhuo-Xu Cui,Dong Liang
2023-09-24
Abstract:Recently, regularization model-driven deep learning (DL) has gained significant attention due to its ability to leverage the potent representational capabilities of DL while retaining the theoretical guarantees of regularization models. However, most of these methods are tailored for supervised learning scenarios that necessitate fully sampled labels, which can pose challenges in practical MRI applications. To tackle this challenge, we propose a self-supervised DL approach for accelerated MRI that is theoretically guaranteed and does not rely on fully sampled labels. Specifically, we achieve neural network structure regularization by exploiting the inherent structural low-rankness of the $k$-space data. Simultaneously, we constrain the network structure to resemble a nonexpansive mapping, ensuring the network's convergence to a fixed point. Thanks to this well-defined network structure, this fixed point can completely reconstruct the missing $k$-space data based on matrix completion theory, even in situations where full-sampled labels are unavailable. Experiments validate the effectiveness of our proposed method and demonstrate its superiority over existing self-supervised approaches and traditional regularization methods, achieving performance comparable to that of supervised learning methods in certain scenarios.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to achieve complete reconstruction of accelerated MRI through self - supervised learning methods in the absence of fully - sampled labels in magnetic resonance imaging (MRI). Specifically, the authors propose a Deep Unfolded Equilibrium Models based on matrix completion theory, aiming to utilize the structural low - rank property of k - space data to regularize the neural network structure and constrain the network structure to be similar to a non - expansive mapping to ensure that the network converges to a fixed point. This fixed point can completely reconstruct the missing k - space data according to the matrix completion theory without fully - sampled labels. ### Main contributions: 1. **Network structure design**: Inspired by the structural low - rank property of k - space data and combined with the principle that Hankel matrix multiplication is equivalent to convolution, a convolutional neural network structure is designed to achieve internal regularization of the network structure. At the same time, additional constraints are imposed on the network architecture to ensure its non - expansiveness, thereby ensuring that the network can converge to a fixed point. 2. **Theoretical guarantee**: Based on matrix completion theory, even in the self - supervised learning scenario where fully - sampled labels are lacking, under specific conditions, the fixed point to which the network converges is also the unique true solution to the imaging inverse problem, that is, complete reconstruction can be achieved. To the best of the authors' knowledge, this is the first method to achieve complete reconstruction in self - supervised learning. 3. **Experimental verification**: The experimental results verify the effectiveness of the proposed method and show that its performance is comparable to that of supervised learning methods in some cases and is superior to existing self - supervised methods and traditional regularization methods. ### Problems solved: - **Accelerated MRI**: By reconstructing complete images from undersampled k - space data, the MRI scanning time is reduced, patient comfort is improved, and motion artifacts are reduced. - **Self - supervised learning**: In the absence of fully - sampled labels, the network is trained using self - supervised learning methods, solving the difficulty of obtaining fully - sampled labels in practical applications. - **Theoretical guarantee**: It provides a theoretical guarantee to ensure that complete reconstruction of missing k - space data can be achieved after the network converges to a fixed point. ### Method overview: - **Forward model**: Multi - channel k - space data acquisition can be represented by a forward model, that is, \( \mathbf{y}_\Omega=\mathbf{M}_\Omega\hat{\mathbf{x}}+\mathbf{n} \), where \( \mathbf{y}_\Omega \) is the undersampled k - space data, \( \mathbf{M}_\Omega \) is the undersampling mask, \( \hat{\mathbf{x}} \) is the fully - sampled k - space data, and \( \mathbf{n} \) is the noise. - **Inverse problem**: Reconstructing missing data from undersampled k - space data is an inverse problem, and a regularization model based on prior information needs to be constructed. Since multi - channel k - space data has a structural low - rank prior, the interpolation problem of missing k - space data can be expressed as: \[ \min_{\hat{\mathbf{x}}}\|\mathbf{H}(\hat{\mathbf{x}}, d)\mathbf{s}\|_F^2\quad\text{s.t.}\quad\mathbf{M}_\Omega\hat{\mathbf{x}}=\mathbf{y}_\Omega \] where \( \mathbf{H}(\hat{\mathbf{x}}, d) \) is the winding Hankel matrix and \( \mathbf{s} \) is the null - space filter of the matrix. - **Network design**: Utilizing the relationship that Hankel matrix multiplication is equivalent to convolution, the above model is transformed into a convolutional form, and a recursive residual convolutional neural network is designed to solve the constrained optimization problem by the projected gradient descent (PGD) algorithm. - **Self - supervised learning**: The Deep Equilibrium Model (DEQ) strategy is introduced to ensure that the network can converge to a fixed point, and the network is trained by self - supervised learning methods, using partially - sampled data for training and avoiding dependence on fully - sampled labels. ### Experimental results: - **Ablation experiment**: By comparing with supervised learning...