Abstract:Although Web search techniques have greatly facilitate users’ information seeking, there are still quite a lot of search sessions that cannot provide satisfactory results, which are more serious in Web image search scenarios. How to understand user intent from observed data is a fundamental issue and of paramount significance in improving image search performance. Previous research efforts mostly focus on discovering user intent either from clickthrough behavior in user search logs (e.g., Google), or from social data to facilitate vertical image search in a few limited social media platforms (e.g., Flickr). This article aims to combine the virtues of these two information sources to complement each other, that is, sensing and understanding users’ interests from social media platforms and transferring this knowledge to rerank the image search results in general image search engines. Toward this goal, we first propose a novel social-sensed image search framework, where both social media and search engine are jointly considered. To effectively and efficiently leverage these two kinds of platforms, we propose an example-based user interest representation and modeling method, where we construct a hybrid graph from social media and propose a hybrid random-walk algorithm to derive the user-image interest graph. Moreover, we propose a social-sensed image reranking method to integrate the user-image interest graph from social media and search results from general image search engines to rerank the images by fusing their social relevance and visual relevance. We conducted extensive experiments on real-world data from Flickr and Google image search, and the results demonstrated that the proposed methods can significantly improve the social relevance of image search results while maintaining visual relevance well.

Discovering User Interests from Social Images.

Mining User Interests from Personal Photos

A Picture Tells a Thousand Words -- About You! User Interest Profiling from User Generated Visual Content

Dynamic Semantic Clustering Approach For Web User Interest

Clustering and Visualization of Social Network Based on User Interests

Who are Like-minded: Mining User Interest Similarity in Online Social Networks

Social-Sensed Image Search.

Modeling Temporal Dynamics of User Interests in Online Social Networks

Building User Profiles from Shared Photos

Social Image Sentiment Analysis by Exploiting Multimodal Content and Heterogeneous Relations

Social Diffusion Analysis with Common-Interest Model for Image Annotation

A Three-Layer Model on Users' Interests Mining.

D-Sempre: Learning Deep Semantic-Preserving Embeddings for User interests-Social Contents Modeling

Inferring User Interests in Microblogging Social Networks: A Survey

Discovering User Preference from Folksonomy

Recommending Flickr Groups with Social Topic Model

Mining User Interests from Information Sharing Behaviors in Social Media.

A Personalized Image Retrieval Based on User Interest Model

Discerning Individual Interests and Shared Interests for Social User Profiling

Hybrid Interest Modeling for Long-tailed Users

Tag-Based User Interest Discovery Though Keywords Extraction in Social Network.