Abstract:Motivated by the attention on salient objects, conventional region-of-interest (ROI)-based image coding approaches attempt to assign more bits to ROIs and fewer bits to other regions. Thus, the perceptual quality of salient object regions is improved by sacrificing the quality of non-ROI regions with unpleasant artifacts. To address this issue, we concentrate on the efficient compression of object-centered images by encoding salient objects and background features separately. To fully recover the object and background, we propose a hierarchical exemplar-based matching-synthesis (HEMS) approach to reconstruct the image from exemplars. In the proposed framework, once the salient object regions are encoded, only the quantized color features and local descriptors of the background are kept, achieving bit-rate reduction. To make it possible and practical to reconstruct background regions, the hierarchical framework is designed in three layers, including relevant image search, patch candidates matching, and distortion optimized image synthesis. In the hierarchical framework, firstly, image search from an external database returns relevant images, limiting the search space to a feasible number of patch candidates. Secondly, patches are matched by color features to select the appropriate candidates. Finally, the distortion optimized image synthesis further makes it possible to automatically choose the most suitable texture sample, and seamlessly reconstruct the image. Compared to the conventional ROI-based image coding schemes, the proposed approach can achieve better visual quality on both ROI and background regions.

Supplementary File to “ Non-local Image Smoothing with Objective Evaluation ”

A blur insensitive structural similarity for image quality assessment

Pixel-Level Non-local Image Smoothing With Objective Evaluation

Block-Extraction and Haar Transform Based Linear Singularity Representation for Image Enhancement

A New Image Coding Quality Assessment.

Efficient Global Color, Luminance, and Contrast Consistency Optimization for Multiple Remote Sensing Images

Image Smoothing via Multiscale Global Perception

Image smoothing based on global sparsity decomposition and a variable parameter

Realization of Relationship Matrix Based on Error Threshold and Least Squares Method in Image Mosaic

Hems: Hierarchical Exemplar-Based Matching-Synthesis for Object-Aware Image Reconstruction

Image Quality Assessment Using Contourlet Transform

A Full-Reference Image Quality Assessment Algorithm Based on Haar Wavelet Transform

Image Quality Assessment with Saliency Map in Nonsubsampled Contourlet Transform Domain

A Question in Laplacian Smoothing Transform for Face Recognition and Related Algorithms

Single Image Super Resolution Using Local Smoothness and Nonlocal Self-Similarity Priors

Edge-preserving Smoothing for Image Decomposition Via a Hybrid Approach

Real-time Image Smoothing via Iterative Least Squares

An Improved Structural Similarity for Image Quality Assessment

Mmse-Directed Linear Image Interpolation Based on Nonlocal Geometric Similarity

Image super resolution based on local self examples with nonlocal constraints and enhancement with 2-order holomorphic complete differential kernel

Image Smoothing Based on Image Decomposition and Sparse High Frequency Gradient