Abstract:Recently, data-driven techniques have demonstrated remarkable effectiveness in addressing challenges related to MR imaging inverse problems. However, these methods still exhibit certain limitations in terms of interpretability and robustness. In response, we introduce Convex Latent-Optimized Adversarial Regularizers (CLEAR), a novel and interpretable data-driven paradigm. CLEAR represents a fusion of deep learning (DL) and variational regularization. Specifically, we employ a latent optimization technique to adversarially train an input convex neural network, and its set of minima can fully represent the real data manifold. We utilize it as a convex regularizer to formulate a CLEAR-informed variational regularization model that guides the solution of the imaging inverse problem on the real data manifold. Leveraging its inherent convexity, we have established the convergence of the projected subgradient descent algorithm for the CLEAR-informed regularization model. This convergence guarantees the attainment of a unique solution to the imaging inverse problem, subject to certain assumptions. Furthermore, we have demonstrated the robustness of our CLEAR-informed model, explicitly showcasing its capacity to achieve stable reconstruction even in the presence of measurement interference. Finally, we illustrate the superiority of our approach using MRI reconstruction as an example. Our method consistently outperforms conventional data-driven techniques and traditional regularization approaches, excelling in both reconstruction quality and robustness.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenge in accelerating the image reconstruction process in magnetic resonance imaging (MRI). Specifically, the paper focuses on how to improve the reconstruction speed of MRI images while maintaining high reconstruction quality, especially in the case of undersampled data. Although traditional acceleration methods are effective, they often lead to a decline in image quality when dealing with undersampled data, especially performing poorly in detail restoration and noise - resistance performance. To address these challenges, the authors propose a new learnable convex regularization method - Convex Latent - Optimized Adversarial Regularizers (CLEAR). This method combines the advantages of deep learning and variational regularization. By introducing latent optimization techniques, it adversarially trains an input convex neural network so that its minimum set can fully represent the real - data manifold. Then, this convex regularizer is used to construct a CLEAR - guided variational regularization model to guide the solution of the image inverse problem on the real - data manifold. ### Main contributions 1. **Propose the CLEAR model**: A learnable convex adversarial regularizer based on latent optimization, whose minimum set can fully represent the real - data manifold, and use it as a convex regularizer to construct a variational regularization model. 2. **Prove convergence**: Utilize the convexity characteristics to prove the convergence of the projected sub - gradient descent algorithm in the CLEAR - guided regularization model, thereby ensuring the unique solution of the image inverse problem. 3. **Verify robustness**: Demonstrate that the CLEAR - guided regularization model can still achieve stable reconstruction in the presence of measurement interference. 4. **Experimental verification**: The experimental results on two MRI datasets show that the CLEAR method is superior to the traditional TV method, AR - learned regularization method, and WGAN in terms of image reconstruction quality and noise - resistance performance. ### Method overview - **Latent optimization**: Through latent optimization techniques, learn the distance from the initial input to the real - data manifold instead of directly learning the distance from the input data to the real - data manifold. - **Convexity constraint**: Impose a convexity constraint on the function \(f\) to ensure that its optimal value can be accurately determined, thereby improving the effectiveness of the method. ### Mathematical expressions - **Variational regularization model**: \[ \arg\min_x \|Ax - b\|^2+\lambda R(x) \] where \(\|Ax - b\|^2\) is the data fidelity term and \(R(x)\) is the regularization term. - **CLEAR model**: \[ \max_{f\in\Gamma}\min_{x\in X} f(x)-\mathbb{E}_{x^+\sim P_r}[f(x^+)] \] where \(\Gamma\) represents the set of 1 - Lipschitz continuous convex functions and \(P_r\) represents the distribution of real data. ### Experimental results - **Reconstruction performance under no - noise conditions**: On the knee joint dataset, using 1D uniform and random sampling patterns, the CLEAR method performs excellently in detail restoration and noise - resistance performance. - **Reconstruction performance at a high acceleration rate**: At a 5 - fold acceleration rate, the CLEAR method can still effectively retain details, while other methods such as TV and WGAN have problems such as over - smoothing or introducing false details. In conclusion, this paper successfully solves the key problems in MRI image reconstruction by proposing the CLEAR model, providing higher reconstruction quality and robustness.

Convex Latent-Optimized Adversarial Regularizers for Imaging Inverse Problems

Statistical Image Reconstruction for Low-Dose Ct Using Nonlocal Means-Based Regularization

Learned convex regularizers for inverse problems

A Neural-Network-Based Convex Regularizer for Inverse Problems

Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation

An Optimal Control Approach for Inverse Problems with Deep Learnable Regularizers

Model-Aware Regularization For Learning Approaches To Inverse Problems

Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithms

Deep Equilibrium Learning of Explicit Regularizers for Imaging Inverse Problems

Convergent Data-driven Regularizations for CT Reconstruction

Noise-Generating and Imaging Mechanism Inspired Implicit Regularization Learning Network for Low Dose CT Reconstrution.

Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation

Provably Convergent Data-Driven Convex-Nonconvex Regularization

CLEAR: Comprehensive Learning Enabled Adversarial Reconstruction for Subtle Structure Enhanced Low-Dose CT Imaging

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties

A New Detail-Preserving Regularization Scheme.

Neural networks-based regularization for large-scale medical image reconstruction

Simulation of Bioluminescence Tomography Based on Nonconvex L1-2 Regularization

Curvature regularization for Non-line-of-sight Imaging from Under-sampled Data