Abstract:Image retargeting aims to adjust the resolution and aspect ratio to an arbitrary size while preserving important content of the image. Usually multi-operator image retargeting demonstrates better generalization than single operator scheme due to heterogeneous characteristics of different regions in the image. Most existing multi-operator retargeting methods search the optimal operator at each step with exponential complexity and with the possibility of falling into local optimum. Therefore, in order to produce better results with lower computational costs, we formulate the multi-operator retargeting as a Markov decision-making process and apply Reinforcement Learning (RL) to achieve global optimum. Instead of using traditional image-level measures, we design a high-level semantic and aesthetic reward function to better match human visual perception. With the priori in reward, we further propose a weakly supervised Semantics and Aesthetics aware Multi-operator Image Retargeting (SAMIR) framework. Particularly, the semantic part of the reward helps to constrain the severe deformations that may occur during retargeting process, while the aesthetic part guarantees the sensory quality, which can effectively measure the perceptual effects of different operators on various image content. The operator of each step is learned in an end-to-end manner. In addition, retargeting can be performed in arbitrary target size, step size, and direction. The experiment results on both representative aesthetic datasets and retargeting datasets consistently show that our model outperforms the state-of-the-art methods.

Multi-operator Image Retargeting Based on Automatic Quality Assessment

Objective Quality Assessment of Retargeted Images Based on RBF Neural Network with Structural Distortion and Content Change

Weakly Supervised Reinforced Multi-Operator Image Retargeting

Objective Quality Prediction of Image Retargeting Algorithms

Image Retargeting by Combining Region Warping and Occlusion.

Learning Quality Assessment of Retargeted Images

An Adaptive Weight Value-Based Multi-Scale Retinex Algorithm for Color Image Enhancement

Lowcomplexity Content-Aware Image Retargeting

Objective quality assessment for image retargeting based on hybrid distortion pooled model

Multi-operator image retargeting with automatic integration of direct and indirect seam carving

Automatic Image Retargeting Evaluation Based on User Perception.

Image Retargeting Assessment Based on Salient Region Similarity

Video Retargeting Using Optimized Crop-and-scale

Efficient Image Retargeting Via Adaptive Pixel Fusion

A Content-Aware Image Retargeting Quality Assessment Method Using Foreground and Global Measurement

A Deep Evaluator for Image Retargeting Quality by Geometrical and Contextual Interaction

Objective Quality Assessment of Image Retargeting by Incorporating Fidelity Measures and Inconsistency Detection.

Strip based media retargeting via combing multi-operators

Full Reference Quality Assessment for Image Retargeting Based on Natural Scene Statistics Modeling and Bi-Directional Saliency Similarity.

Image retargeting using multi-map constrained region warping.

Image Retargeting Based on Region Relation Graph