Abstract:Proximal gradient-based optimization is one of the most common strategies to solve inverse problem of images, and it is easy to implement. However, these techniques often generate heavy artifacts in image reconstruction. One of the most popular refinement methods is to fine-tune the regularization parameter to alleviate such artifacts, but it may not always be sufficient or applicable due to increased computational costs. In this work, we propose a deep geometric incremental learning framework based on the second Nesterov proximal gradient optimization. The proposed end-to-end network not only has the powerful learning ability for high-/low-frequency image features, but also can theoretically guarantee that geometric texture details will be reconstructed from preliminary linear reconstruction. Furthermore, it can avoid the risk of intermediate reconstruction results falling outside the geometric decomposition domains and achieve fast convergence. Our reconstruction framework is decomposed into four modules including general linear reconstruction, cascade geometric incremental restoration, Nesterov acceleration, and post-processing. In the image restoration step, a cascade geometric incremental learning module is designed to compensate for missing texture information from different geometric spectral decomposition domains. Inspired by the overlap-tile strategy, we also develop a post-processing module to remove the block effect in patch-wise-based natural image reconstruction. All parameters in the proposed model are learnable, an adaptive initialization technique of physical parameters is also employed to make model flexibility and ensure converging smoothly. We compare the reconstruction performance of the proposed method with existing state-of-the-art methods to demonstrate its superiority. Our source codes are available at <a class="link-external link-https" href="https://github.com/fanxiaohong/Nest-DGIL" rel="external noopener nofollow">this https URL</a>.

Iterative Relaxing Gradient Projection for Continual Learning

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

Restricted Orthogonal Gradient Projection for Continual Learning

Progressive Learning without Forgetting

TRGP: Trust Region Gradient Projection for Continual Learning

Gradient Projection Memory for Continual Learning

Orthogonal Gradient Descent for Continual Learning

Learning with Recoverable Forgetting

Adaptive Orthogonal Projection for Continual Learning

Gradient Projection For Continual Parameter-Efficient Tuning

Principal Gradient Direction and Confidence Reservoir Sampling for Continual Learning

Continual Learning with Recursive Gradient Optimization

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Adaptive Orthogonal Projection for Batch and Online Continual Learning.

Pseudo inverse versus iterated projection: Novel learning approach and its application on broad learning system

CODE-CL: COnceptor-Based Gradient Projection for DEep Continual Learning

The Solution for the sequential task continual learning track of the 2nd Greater Bay Area International Algorithm Competition

Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning

Nest-DGIL: Nesterov-optimized Deep Geometric Incremental Learning for CS Image Reconstruction

Learning soft threshold for sparse reparameterization using gradual projection operators

Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural Activations