Abstract:In the past two decades, there has been a huge amount of document data with rich tag information during the evolution of the Internet, which can be called semi-structured data. These semi-structured data contain both unstructured features (e.g., plain text) and metadata, such as tags in html files or author and venue information in research articles. It's of great interest to model such kind of data. Most previous works focused on modeling the unstructured data. Some other methods have been proposed to model the unstructured data with specific tags. To build a general model for semi-structured documents remains an important problem in terms of both model fitness and efficiency. In this paper, we propose a novel method to model the tagged documents by a so-called Tag-Weighted Dirichlet Allocation (TWDA). TWDA is a framework that leverages both the tags and words in each document to infer the topic components for the documents. This allows not only to learn the document-topic and topic-word distributions, but also to infer the tag-topic distributions for text mining (e.g., classification, clustering, and recommendations). Moreover, TWDA can automatically infer the probabilistic weights of tags for each document, that can be used to predict the tags in one document. We present an efficient variational inference method with an EM algorithm for estimating the model parameters. The experimental results show the effectiveness, efficiency and robustness of our TWDA approach by comparing it with the state-of-the-art methods on four corpora in document modeling, tags prediction and text classification.

ITWF: A Framework to Apply Term Weighting Schemes in Topic Model

Exploring coherent topics by topic modeling with term weighting.

Exploring Topic Discriminating Power of Words in Latent Dirichlet Allocation.

A Novel Topic Model for Automatic Term Extraction

A Weighted Topic Modeling Approach Based on Word Embedding

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Tag-Weighted Topic Model for Mining Semi-Structured Documents.

Incorporating Concept Information into Term Weighting Schemes for Topic Models

Improving the term weighting log entropy of latent dirichlet allocation

A generic multi-level framework for building term-weighting schemes in text classification

A study of supervised term weighting scheme for sentiment analysis

A Novel Term Weighting Scheme for Automated Text Categorization

Topic Tracking with Dynamic Topic Model and Topic-based Weighting Method.

Tag-Weighted Dirichlet Allocation

Short Text Topic Modeling With Flexible Word Patterns

A Learning-Based Term-Weighting Approach for Information Retrieval

An Improved Term Weighting Scheme for Text Classification

Several alternative term weighting methods for text representation and classification

Topic-weak-correlated Latent Dirichlet Allocation

Term frequency – function of document frequency: a new term weighting scheme for enterprise information retrieval

Topic Modeling over Short Texts by Incorporating Word Embeddings