Abstract:Interactive visualization of large image collections is important and useful in many applications, such as personal album management and user profiling on images. However, most prior studies focus on using low-level visual features of images, such as texture and color histogram, to create visualizations without considering the more important semantic information embedded in images. This paper proposes a novel visual analytic system to analyze images in a semantic-aware manner. The system mainly comprises two components: a semantic information extractor and a visual layout generator. The semantic information extractor employs an image captioning technique based on convolutional neural network (CNN) to produce descriptive captions for images, which can be transformed into semantic keywords. The layout generator employs a novel co-embedding model to project images and the associated semantic keywords to the same 2D space. Inspired by the galaxy metaphor, we further turn the projected 2D space to a galaxy visualization of images, in which semantic keywords and images are visually encoded as stars and planets. Our system naturally supports multi-scale visualization and navigation, in which users can immediately see a semantic overview of an image collection and drill down for detailed inspection of a certain group of images. Users can iteratively refine the visual layout by integrating their domain knowledge into the co-embedding process. Two task-based evaluations are conducted to demonstrate the effectiveness of our system.

Semantic Word Cloud Generation Based on Word Embeddings

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Visual Exploration and Comparison of Word Embeddings.

MySemCloud: Semantic-aware Word Cloud Editing

Semantic-Preserving Word Clouds by Seam Carving

Creating Word Paintings Jointly Considering Semantics, Attention, and Aesthetics.

Semantic Word Clouds with Background Corpus Normalization and t-distributed Stochastic Neighbor Embedding

A Semantic Relatedness Service Based on Folksonomy

Semantic Visualization for Short Texts with Word Embeddings

How to Improve Semantics Understanding of Word Clouds

Context preserving dynamic word cloud visualization

Low-dimensional Semantic Space: from Text to Word Embedding

Document Visualization using Topic Clouds

Category Enhanced Word Embedding.

A General Framework For Text Semantic Analysis And Clustering On Yelp Reviews

Context-Preserving, Dynamic Word Cloud Visualization

Learning Semantic Hierarchies Via Word Embeddings.

Latent Semantic Analysis Approach for Document Summarization Based on Word Embeddings

Refined Global Word Embeddings Based on Sentiment Concept for Sentiment Analysis

The Influence of Font Scale on Semantic Expression of Word Cloud.

A Semantic-Based Method for Visualizing Large Image Collections.