Abstract:Proximal gradient-based optimization is one of the most common strategies to solve inverse problem of images, and it is easy to implement. However, these techniques often generate heavy artifacts in image reconstruction. One of the most popular refinement methods is to fine-tune the regularization parameter to alleviate such artifacts, but it may not always be sufficient or applicable due to increased computational costs. In this work, we propose a deep geometric incremental learning framework based on the second Nesterov proximal gradient optimization. The proposed end-to-end network not only has the powerful learning ability for high-/low-frequency image features, but also can theoretically guarantee that geometric texture details will be reconstructed from preliminary linear reconstruction. Furthermore, it can avoid the risk of intermediate reconstruction results falling outside the geometric decomposition domains and achieve fast convergence. Our reconstruction framework is decomposed into four modules including general linear reconstruction, cascade geometric incremental restoration, Nesterov acceleration, and post-processing. In the image restoration step, a cascade geometric incremental learning module is designed to compensate for missing texture information from different geometric spectral decomposition domains. Inspired by the overlap-tile strategy, we also develop a post-processing module to remove the block effect in patch-wise-based natural image reconstruction. All parameters in the proposed model are learnable, an adaptive initialization technique of physical parameters is also employed to make model flexibility and ensure converging smoothly. We compare the reconstruction performance of the proposed method with existing state-of-the-art methods to demonstrate its superiority. Our source codes are available at <a class="link-external link-https" href="https://github.com/fanxiaohong/Nest-DGIL" rel="external noopener nofollow">this https URL</a>.

Interpretable model-driven projected gradient descent network for high-quality fDOT reconstruction

Deep Background-Mismodeling-learned Reconstruction for High-Accuracy Fluorescence Diffuse Optical Tomography.

Diff-FMT: Diffusion Models for Fluorescence Molecular Tomography

Model-based Graph Convolutional Network for Diffuse Optical Tomography

Diffusion Equation Engine Deep Learning for Diffuse Optical Tomography

Rapid high-quality PET Patlak parametric image generation based on direct reconstruction and temporal nonlocal neural network.

Recovering high-quality FODs from a reduced number of diffusion-weighted images using a model-driven deep learning architecture

Back-propagation Neural Network-Based Reconstruction Algorithm for Diffuse Optical Tomography

FDU-Net: Deep Learning-Based Three-Dimensional Diffuse Optical Image Reconstruction

3D Deep Encoder-Decoder Network for Fluorescence Molecular Tomography.

Enhanced Model Iteration Algorithm with Graph Neural Network for Diffuse Optical Tomography.

Two-stage deep learning method for sparse-view fluorescence molecular tomography reconstruction

Accelerating fDOT image reconstruction based on path-history fluorescence Monte Carlo model by using three-level parallel architecture.

Fluorescence diffuse optical monitoring of bioreactors: a hybrid deep learning and model-based approach for tomography

A Self-supervised Learning Reconstruction Algorithm with an Encoder-Decoder Architecture for Diffuse Optical Tomography

InDuDoNet: An Interpretable Dual Domain Network for CT Metal Artifact Reduction

Deep Generalized Learning Model for PET Image Reconstruction

A Modular Deep Learning-based Approach for Diffuse Optical Tomography Reconstruction

Model-Guided Iterative Diffusion Sampling for NLOS Reconstruction

Based on Model-driven Fast Iterative Shrinkage Thresholding Network for Bioluminescence Tomography Reconstruction

Nest-DGIL: Nesterov-optimized Deep Geometric Incremental Learning for CS Image Reconstruction