Chengyang Liu,Michael K. Ng
Abstract:The image retargeting problem is to find a proper mapping to resize an image to one with a prescribed aspect ratio, which is quite popular these days. In this paper, we propose an efficient and orientation-preserving one-step image retargeting algorithm based on minimizing the harmonic energy, which can well preserve the regions of interest (ROIs) and line structures in the image. We also give some mathematical proofs in the paper to ensure the well-posedness and accuracy of our algorithm.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the geometric distortion and information loss in image retargeting. Specifically, the author proposes a one - step image retargeting algorithm based on minimizing harmonic energy, aiming to adjust the image to a specified aspect ratio while maintaining the integrity of the regions of interest (ROIs) and line structures in the image as much as possible.
### Problem Background
With the diversification of the screen ratios of electronic devices, simply stretching the image to adapt to different devices will lead to visual unnaturalness and loss of geometric information. Therefore, it is necessary to develop new image retargeting algorithms that preserve some important properties of the original image while resizing it.
### Shortcomings of Existing Methods
1. **Cropping - based methods**: For example, the Seam Carving algorithm adjusts the image size by removing unimportant pixels, but sometimes it will damage important objects in the image.
2. **Mesh - based warping methods**: It adjusts the image size by dividing triangular or quadrilateral meshes and calculating vertex coordinates. Although it can minimize the geometric distortion in important areas, it allows large distortion in unimportant areas. However, these methods ignore the difference between conformal mapping and harmonic mapping, resulting in huge errors in quasi - conformal mapping, and the generated map may not be orientation - preserving.
### Solution Proposed in the Paper
The author proposes a one - step image retargeting algorithm based on minimizing harmonic energy, which has the following characteristics:
- **Conformal Energy**: Introduce conformal energy as a standard for measuring local geometric distortion to ensure that the distortion distribution is as uniform as possible.
- **One - step algorithm**: Complete the image retargeting through one calculation, improving efficiency.
- **Orientation - preserving**: Ensure that the generated mapping is bijective and orientation - preserving, avoiding information loss and geometric distortion.
### Mathematical Model
To achieve the above goals, the author constructs a mathematical model to describe the image retargeting problem. The specific formulas are as follows:
Let the original image be \(I: D_1\rightarrow\mathbb{R}\), where \(D_1 = [0, a]\times[0, b]\subset\mathbb{R}^2\), and the target image be \(I': D_2\rightarrow\mathbb{R}\), where \(D_2 = [0, wa]\times[0, b]\subset\mathbb{R}^2\), and \(w\) is the scaling ratio. For the regions of interest \(O_i\) and line structures \(l_j\), they are defined as follows:
\[
f|_{O_i}(x)=r_Ox + t_{O_i}\in D_2,
\]
\[
f|_{l_j}(x)=R_{l_j}x + t_{l_j}\in D_2,
\]
where \(r_O\in\mathbb{R}_+\), \(R_{l_j}=\begin{pmatrix}r_{x_{l_j}}&0\\0&r_{y_{l_j}}\end{pmatrix}\) is a diagonal matrix, and \(t_{O_i}, t_{l_j}\in\mathbb{R}^2\).
The boundary condition \(g\) is a bijective continuous mapping that satisfies:
\[
g(0,0)=(0,0),\quad g(a,0)=(wa,0),\quad g(0,b)=(0,b),\quad g(a,b)=(wa,b).
\]
### Conclusion
This paper proposes a...