Abstract:Recently, Folksonomy attracts attentions as a new method to index large-scale image databases. In the Folksonomy-style image databases, they allows users to attach keywords to images as “tags”. Since tag words are uncontrolled, they have various and many kinds of tags associated with images. This is much different from conventional image databases. In this paper, we propose a novel method to extract hierarchical structure on relations between tags from Folksonomy. The tag structure we extract can be used as an ontology for image database search which reflects both textual and visual relations between tags. In the proposed method, at first, we collect millions of tag-attached-images from Flickr which is the world-largest Folksonomy-style image database, and remove noise images from them. Next, we estimate concept vectors for highly-frequent tags based on only visual features, only tag word features and combined features of both visual and textual features, and compute JS divergence and entropy for three kinds of concept vectors. Finally we estimate hierarchical structures between tags regarding three kinds of concept vectors. In the experiments, we show the obtained hierarchical structure, and it includes interesting relations which sometimes are difficult to be discovered by human. In addition, as its application, we used and evaluated the obtained ontology for query expansion of text-tag-based image search over Flickr. These results indicate that the proposed method is promising and the structure is expected to help image search and some other applications.

A Technology of Ontology-based Photo Annotation

Ontology-based digital photo annotation using multi-source information

Ontology-based Automatic image Annotation

OntoAlbum: An Ontology Based Digital Photo Management System

Ontology Construction for Scientific Visualization

Ontology Model and Its Application in Quality Knowledge Management

An Ontology-Based Automatic Semantic Annotation Approach for Patent Document Retrieval in Product Innovation Design

Research on ontology modeling of digital family photos management

Mobile Ontology.

Automatic Construction of a Folksonomy-Based Visual Ontology

An Ontology-Based Approach To Retrieve Digitized Art Images

A Framework for Ontology-Based Annotation of Learning Object Content

Ontology-Based Annotation of Multimedia Language Data for the Semantic Web

Ontology Service Center: a datahub for ontology application

A web-based approach for image annotation

Ontology and XML Based Data Exchange System

WNtags: A Web-Based Tool For Image Labeling And Retrieval With Lexical Ontologies

ImageSpace: An Environment for Image Ontology Management

Image annotation using search and mining technologies.

Personalized Annotation for Mobile Photos Based on User's Social Circle.

Visual Ontology Construction for Digitized Art Image Retrieval