Abstract:The Topic Detection task is focused on discovering the main topics addressed by a series of documents (e.g., news reports, e-mails, tweets). Topics, defined in this way, are expected to be thematically similar, cohesive and self-contained. This task has been broadly studied from the point of view of clustering and probabilistic techniques. In this work, we propose for this task the application of Formal Concept Analysis (FCA), an exploratory technique for data analysis and organization. In particular, we propose an extension of FCA-based methods for topic detection applied in the literature by applying the stability concept for the topic selection. The hypothesis is that FCA will enable the better organization of the data and stability the better selection of topics based on this data organization, thus better fulfilling the task requirements by improving the quality and accuracy of the topic detection process. In addition, the proposed FCA-based methodology is able to cope with some well-known drawbacks that clustering and probabilistic methodologies present, such as: the need to set a predefined number of clusters or the difficulty in dealing with topics with complex generalization-specialization relationships. In order to prove this hypothesis, the FCA operation is compared to other established techniques — Hierarchical Agglomerative Clustering (HAC) and Latent Dirichlet Allocation (LDA). To allow this comparison, these approaches have been implemented by the authors in a novel experimental framework. The quality of the topics detected by the different approaches in terms of their suitability for the topic detection task is evaluated by means of internal clustering validity metrics. This evaluation demonstrates that FCA generates cohesive clusters, which are less subject to changes in cluster granularity. Driven by the quality of the detected topics, FCA achieves the best general outcome, improving the experimental results for Topic Detection Task at the 2013 Replab Campaign.

Formal Concept Analysis Support for Web Document Clustering Based on Social Tagging

Analysis Of Tag Within Online Social Networks

Tags Are Related: Measurement of Semantic Relatedness Based on Folksonomy Network

Complex Network Analysis of Tag As a Social Network

Semantic Relatedness in Folksonomy

A Semantic Relatedness Service Based on Folksonomy

Annotation-aware web clustering based on topic model and random walks

Tag Clustering and Refinement on Semantic Unity Graph

Program Clustering for Comprehension Based on Fuzzy Formal Concept Analysis

Wt-Lda: User Tagging Augmented Lda For Web Service Clustering

Study on User Behavior and Social Tagging

An Image Clustering Algorithm in Collaborative Tagging System

TagClus: a Random Walk-Based Method for Tag Clustering

Concept chain based text clustering

Formal concept analysis for topic detection: A clustering quality experimental analysis

Tag Clustering Algorithm Using Object-based Feature Vector

Tag-oriented document summarization.

Fe b 20 11 Self-organization in social tagging systems

A Neighborhood Search Method for Link-Based Tag Clustering

Web Documents Clustering with Interest Links

Exploiting User Tagging for Web Service Co-Clustering.