Abstract:Image smoothing is a fundamental procedure in applications of both computer vision and graphics. The required smoothing properties can be different or even contradictive among different tasks. Nevertheless, the inherent smoothing nature of one smoothing operator is usually fixed and thus cannot meet the various requirements of different applications. In this paper, we first introduce the truncated Huber penalty function which shows strong flexibility under different parameter settings. A generalized framework is then proposed with the introduced truncated Huber penalty function. When combined with its strong flexibility, our framework is able to achieve diverse smoothing natures where contradictive smoothing behaviors can even be achieved. It can also yield the smoothing behavior that can seldom be achieved by previous methods, and superior performance is thus achieved in challenging cases. These together enable our framework capable of a range of applications and able to outperform the state-of-the-art approaches in several tasks, such as image detail enhancement, clip-art compression artifacts removal, guided depth map restoration, image texture removal, etc. In addition, an efficient numerical solution is provided and its convergence is theoretically guaranteed even the optimization framework is non-convex and non-smooth. A simple yet effective approach is further proposed to reduce the computational cost of our method while maintaining its performance. The effectiveness and superior performance of our approach are validated through comprehensive experiments in a range of applications. Our code is available at https://github.com/wliusjtu/Generalized-Smoothing-Framework.

Deep Scale-Aware Image Smoothing

Image Smoothing via Multiscale Global Perception

Scale-based adaptive smoothing

Image smoothing via unsupervised learning

Image Smoothing Based on Image Decomposition and Sparse High Frequency Gradient

Learning Explicit Smoothing Kernels for Joint Image Filtering

Structure-preserving image smoothing with semantic cues

Structure-preserving Texture Smoothing with Scale-Aware Intensity Aggregation Structure Measurement

Contrastive Semantic-Guided Image Smoothing Network

Revisiting Deep Image Smoothing and Intrinsic Image Decomposition.

Real-time Image Smoothing via Iterative Least Squares

Image smoothing method based on global gradient sparsity and local relative gradient constraint optimization

Deep Image Quality Assessment Driven Single Image Deblurring

Image smoothing based on global sparsity decomposition and a variable parameter

A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing.

Image Smoothing Via Gradient Sparsity and Surface Area Minimization

Pixel-Level Non-local Image Smoothing With Objective Evaluation

Scale-Iterative Upscaling Network for Image Deblurring

Edge-preserving Image Smoothing with Local Constraints on Gradient and Intensity.

Optimized Image Up-Scaling From Learning Selective Similarity

A Generalized Framework for Edge-Preserving and Structure-Preserving Image Smoothing