Abstract:Knowledge discovery from scientific articles has received increasing attention recently since huge repositories are made available by the development of the Internet and digital databases. In a corpus of scientific articles such as a digital library, documents are connected by citations and one document plays two different roles in the corpus: document itself and a citation of other documents. In the existing topic models, little effort is made to differentiate these two roles. We believe that the topic distributions of these two roles are different and related in a certain way. In this paper, we propose a Bernoulli process topic (BPT) model which considers the corpus at two levels: document level and citation level. In the BPT model, each document has two different representations in the latent topic space associated with its roles. Moreover, the multi-level hierarchical structure of citation network is captured by a generative process involving a Bernoulli process. The distribution parameters of the BPT model are estimated by a variational approximation approach. An efficient computation algorithm is proposed to overcome the difficulty of matrix inverse operation. In addition to conducting the experimental evaluations on the document modeling and document clustering tasks, we also apply the BPT model to well known corpora to discover the latent topics, recommend important citations, detect the trends of various research areas in computer science between 1991 and 1998, and to investigate the interactions among the research areas. The comparisons against state-of-the-art methods demonstrate a very promising performance. The implementations and the data sets are available online .

A Latent Topic Model for Linked Documents

Document Clustering Based on Probabilistic Topic Model

Unsupervised Learning from Linked Documents

A Topic Model for Linked Documents and Update Rules for Its Estimation

A Two-Level Topic Model Towards Knowledge Discovery from Citation Networks

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Locally discriminative topic modeling

A Local Context-Aware LDA Model for Topic Modeling in a Document Network

Hierarchical Latent Semantic Mapping for Automated Topic Generation

Latent Topic Model for Image Annotation by Modeling Topic Correlation

A topic-based Document Correlation Model

Topic Discovery and Evolution in Scientific Literature Based on Content and Citations

Content Modeling Using Latent Permutations

Parsimonious Topic Models with Salient Word Discovery

A Topical Link Model for Community Discovery in Textual Interaction Graph.

Topic Modeling Revisited: A Document Graph-based Neural Network Perspective

Analyses of Multi-collection Corpora via Compound Topic Modeling

Sparse Relational Topic Models for Document Networks.

A Hierarchical Latent Topic Model Based on Sparse Coding