Abstract:In order to mine latent semantics from text data, word embedding and topic modeling are two major methodologies in the industry. From a pragmatic perspective, each of these two lines of semantic models faces increasing challenges from real-life applications. Topic modeling view documents as bags of words and is unable to capture the sequential relationship between words. On the other hand, word embedding models the co-occurrence of neighboring words but lacks the global view of the document. Therefore, they can only discover homogenous semantics from a single aspect. However, modern text mining tasks typically require a panoramic view of the latent semantics. Hence, discovering heterogeneous semantics (e.g., heterogeneous types of latent topics) is critical for the performance of these tasks, and it is necessary to design a model that meets this demand. Furthermore, with the arrival of the big data era and the increasing awareness of data privacy, it is necessary to study mining heterogeneous semantics with high efficiency while avoiding compromising data privacy. In this work, we develop a novel method called Heterogeneous Latent Topic Discovery (HLTD) which seamlessly integrates topic modeling with word embedding to discover heterogeneous latent topics. By coupling parameter-server architecture with new private sampling algorithms, HLTD can be efficiently trained to protect underlying data privacy. We evaluate HLTD through a wide range of qualitative and quantitative metrics in the industry. Extensive experiments demonstrate the superiority of HLTD over the state-of-the-arts.

Web Topic Representation Based on Multi-layer Semantic Model

A Multi-Layer Representation Model for Multimedia Web Page and Topic

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Query-focused Multi-document Summarization: Combining a Novel Topic Model with Graph-based Semi-supervised Learning

Research on the Modeling of Semantic-Based Web Resources Feature.

Multi-Dimension Topic Mining Based on Hierarchical Semantic Graph Model

Domain-specific website recognition using hybrid vector space model

Topic Representation: A Novel Method of Tag Recommendation for Text

Visual topic model for web image annotation.

A novel label-based multimodal topic model for social media analysis

Research on Improve Topic Representation over Short Text.

TSSE-DMM: Topic Modeling for Short Texts Based on Topic Subdivision and Semantic Enhancement

Topic Modeling in Semantic Space with Keywords.

A Feature-Word-topic Model for Image Annotation and Retrieval

Semantic Multi-Grain Mixture Topic Model for Text Analysis.

Semantic Link Network-Based Model for Organizing Multimedia Big Data

Latent Topic Text Representation Learning on Statistical Manifolds.

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Heterogeneous Latent Topic Discovery for Semantic Text Mining

Automatic Annotation of Multispectral Satellite Images Using Author–Topic Model