Abstract:Computational photo quality evaluation is a useful technique in many tasks of computer vision and graphics, for example, photo retaregeting, 3-D rendering, and fashion recommendation. The conventional photo quality models are designed by characterizing the pictures from all communities (e.g., “architecture” and “colorful”) indiscriminately, wherein community-specific features are not exploited explicitly. In this article, we develop a new community-aware photo quality evaluation framework. It uncovers the latent community-specific topics by a regularized latent topic model (LTM) and captures human visual quality perception by exploring multiple attributes. More specifically, given massive-scale online photographs from multiple communities, a novel ranking algorithm is proposed to measure the visual/semantic attractiveness of regions inside each photograph. Meanwhile, three attributes, namely: 1) photo quality scores; weak semantic tags; and inter-region correlations, are seamlessly and collaboratively incorporated during ranking. Subsequently, we construct the gaze shifting path (GSP) for each photograph by sequentially linking the top-ranking regions from each photograph, and an aggregation-based CNN calculates the deep representation for each GSP. Based on this, an LTM is proposed to model the GSP distribution from multiple communities in the latent space. To mitigate the overfitting problem caused by communities with very few photographs, a regularizer is incorporated into our LTM. Finally, given a test photograph, we obtain its deep GSP representation and its quality score is determined by the posterior probability of the regularized LTM. Comparative studies on four image sets have shown the competitiveness of our method. Besides, the eye-tracking experiments have demonstrated that our ranking-based GSPs are highly consistent with real human gaze movements.

Image Retrieval Using Spatiograms of Colors Quantized by Gaussian Mixture Models

Image retrieval based on color-spatial histograms

An Image Retrieval System with Color Emotion Query

Image segmentation using spectral clustering of Gaussian mixture models

An Image Retrieval Combining Color and Spatial Information

Image Retrieval Based on Multiview Constrained Nonnegative Matrix Factorization and Gaussian Mixture Model Spectral Clustering Method

Joint appearance and locality image representation by gaussianization

Region-based image retrieval using color coherence region vectors

Image retrieval using both color and local spatial feature histograms

Content-based Image Retrieval Using a Gaussian Mixture Model in the Wavelet Domain.

Image Retrieval Based on Histograms of Eops and Vq Indices

Color Image Retrieval Based on Distance-Weighted Boundary Predictive Vector Quantization Index Histograms.

Graph-Based Features for Image Retrieval

Community-Aware Photo Quality Evaluation by Deeply Encoding Human Perception

Efficient Saliency Detection Based on Gaussian Models

Hierarchical Gaussianization for Image Classification

Texture Image Retrieval Based on A Gaussian Mixture Model and Similarity Measure Using A Kullback Divergence

Large scale partial-duplicate image retrieval with bi-space quantization and geometric consistency

Evaluation on Color Spaces and Distance Measures for Color Histogram-Based Image Retrieval

Gaussian mixture model for relevance feedback in image retrieval

Content-based image retrieval using color moment and Gabor texture feature