Correction: A correlated topic model of Science

David M. Blei,John D. Lafferty

DOI: https://doi.org/10.48550/arXiv.0712.1486

2007-12-10

Applications

Abstract:Correction to Annals of Applied Statistics 1 (2007) 17--35 [doi:10.1214/07-AOAS114]

What problem does this paper attempt to address?

Comparative Study of Chinese-English Scientific Topic Ranking Correlations: Computer Science Perspective

Zhuoren Jiang,Liangcai Gao,Zhao Star,Xiaozhong Liu,Ke Yuan,Zhi Tang

DOI: https://doi.org/10.3772/j.issn.1000-0135.2017.09.008

2017-01-01

Abstract:Topic ranking is an important issue for information retrieval and organization, and in this study, we con-ducted a comprehensive exploration of this issue from static global and dynamic historical perspectives, focusing on a comparative study of Chinese-English scientific topic rank correlations in each dataset, which was based on bibli-ometrics such as the frequency, number of citations, and PageRank value. In the experiment, which was conducted on an English dataset extracted from the Association for Computing Machinery (ACM) and a Chinese dataset extracted from the Wanfang knowledge platform, the correlation relationships of Chinese and English topic rankings were re-vealed and compared using different ranking methods in different historical stages, as well as a dynamic change in the features of different correlation relationships. The experiment results show that, at the different historical stages, the Chinese and English topic rankings using different ranking methods all have positive correlations, and that an English topic ranking in a certain historical stage, with the development of time, will have increasing positive correlations with the Chinese topic rankings. Different ranking methods will change the time range of this increasingly positive correlation effect.
Correlated topic model for image annotation

xing xu,atsushi shimada,rinichiro taniguchi

DOI: https://doi.org/10.1109/FCV.2013.6485488

2013-01-01

Abstract:For the task of image annotation, traditional methods based on probabilistic topic model, such as correspondence Latent Dirichlet Allocation (corrLDA) [1], assumes that image is a mixture of latent topics. However, this kind of models is unable to directly model correlation between topics since topic proportions of an image are generated independently. Our model, called correspondence Correlated Topic Model (corrCTM), extends Correlated Topic Model (CTM) [2] from natural language processing to capture topic correlation from covariance structure of more flexible model distribution. Unlike previous LDA based models, topic proportions are correlated with each other in proposed corrCTM. And the topic correlation propagates from image features to annotation words through a generative process, and finally correspondence between images and words could be generated. We derive an approximate inference and estimation algorithm based on variational method. We examine the performance of our model on two benchmark image datasets, show improved performance over corrLDA for both annotation and modeling word correlation.
A Compound Correlation Model for Disjoint Literature-Based Knowledge Discovery (vol 64, pg 423, 2012)

Shuiqing Huang,Lin He,Bo Yang,Ming Zhang

DOI: https://doi.org/10.1108/00012531211244770

2012-01-01

Aslib Proceedings

Abstract:Purpose - The algorithm of disjoint literature-based knowledge discovery provides a convenient, efficient and effective auxiliary method for scientific research. Based on an analysis of Swanson's A-B-C model of disjoint literature-based knowledge discovery and Gordon's intermediate literature theory, this paper seeks to propose a more comprehensive compound correlation model for disjoint literature-based knowledge discovery. Design/methodology/approach - A new algorithm of vector space model (VSM) based disjoint literature-based knowledge discovery is designed to implement the compound correlation model. Findings - The validity tests showed that this new model not only simulated both of Swanson's early and well-known discoveries of Raynaud's disease-fish oil and migraine-magnesium connections successfully, but also applied to knowledge discovery in the agricultural economics literature in the Chinese language. Research limitations/implications - Although the workload was reduced to the minimum under the compound correlation model compared with other algorithms and models, part of the work needed some manual intervention in the process of disjoint literature-based knowledge discovery with the VSM-based compound correlation model. Practical implications - The algorithm was capable of knowledge discovery with a large-scale dataset and had an advantage in identifying a series of hidden connections among a set of literatures. Therefore, application of the model might be extended to more fields. Originality/value - Traditional two-step knowledge discovery procedures were integrated into the model, which contained open and closed disjoint literature-based knowledge discovery.
Fast, Flexible Models for Discovering Topic Correlation across Weakly-Related Collections

Jingwei Zhang,Aaron Gerow,Jaan Altosaar,James Evans,Richard Jean So

DOI: https://doi.org/10.48550/arXiv.1508.04562

2015-08-19

Abstract:Weak topic correlation across document collections with different numbers of topics in individual collections presents challenges for existing cross-collection topic models. This paper introduces two probabilistic topic models, Correlated LDA (C-LDA) and Correlated HDP (C-HDP). These address problems that can arise when analyzing large, asymmetric, and potentially weakly-related collections. Topic correlations in weakly-related collections typically lie in the tail of the topic distribution, where they would be overlooked by models unable to fit large numbers of topics. To efficiently model this long tail for large-scale analysis, our models implement a parallel sampling algorithm based on the Metropolis-Hastings and alias methods (Yuan et al., 2015). The models are first evaluated on synthetic data, generated to simulate various collection-level asymmetries. We then present a case study of modeling over 300k documents in collections of sciences and humanities research from JSTOR.

Computation and Language,Information Retrieval
Correction to “Insights into the Effects of Violating Statistical Assumptions for Dimensionality Reduction for Chemical “-omics” Data with Multiple Explanatory Variables”

Amber O. Brown,Peter J. Green,Greta J. Frankham,Barbara H. Stuart,Maiken Ueland

DOI: https://doi.org/10.1021/acsomega.4c01126

IF: 4.1

2024-03-19

ACS Omega

Abstract:[This corrects the article DOI: 10.1021/acsomega.3c01613.].

chemistry, multidisciplinary
Parsimonious Topic Models with Salient Word Discovery

Hossein Soleimani,David J. Miller

DOI: https://doi.org/10.1109/TKDE.2014.2345378

2014-09-12

Abstract:We propose a parsimonious topic model for text corpora. In related models such as Latent Dirichlet Allocation (LDA), all words are modeled topic-specifically, even though many words occur with similar frequencies across different topics. Our modeling determines salient words for each topic, which have topic-specific probabilities, with the rest explained by a universal shared model. Further, in LDA all topics are in principle present in every document. By contrast our model gives sparse topic representation, determining the (small) subset of relevant topics for each document. We derive a Bayesian Information Criterion (BIC), balancing model complexity and goodness of fit. Here, interestingly, we identify an effective sample size and corresponding penalty specific to each parameter type in our model. We minimize BIC to jointly determine our entire model -- the topic-specific words, document-specific topics, all model parameter values, {\it and} the total number of topics -- in a wholly unsupervised fashion. Results on three text corpora and an image dataset show that our model achieves higher test set likelihood and better agreement with ground-truth class labels, compared to LDA and to a model designed to incorporate sparsity.

Machine Learning,Computation and Language,Information Retrieval
Model Error Correction in Data Assimilation by Integrating Neural Networks

Jiangcheng Zhu,Shuang Hu,Rossella Arcucci,Chao Xu,Jihong Zhu,Yi-ke Guo

DOI: https://doi.org/10.26599/bdma.2018.9020033

2019-01-01

Big Data Mining and Analytics

Abstract:In this paper, we suggest a new methodology which combines Neural Networks (NN) into Data Assimilation (DA). Focusing on the structural model uncertainty, we propose a framework for integration NN with the physical models by DA algorithms, to improve both the assimilation process and the forecasting results. The NNs are iteratively trained as observational data is updated. The main DA models used here are the Kalman filter and the variational approaches. The effectiveness of the proposed algorithm is validated by examples and by a sensitivity study.
Nonparametric Symmetric Correspondence Topic Models for Multilingual Text Analysis.

Rui Cai,Miaohong Chen,Houfeng Wang

DOI: https://doi.org/10.1007/978-3-319-25207-0_23

2015-01-01

Abstract:Topic model aims to analyze collection of documents and has been widely used in the fields of machine learning and natural language processing. Recently, researchers proposed some topic models for multilingual parallel or comparable documents. The symmetric correspondence Latent Dirichlet Allocation SymCorrLDA is one such model. Despite its advantages over some other existing multilingual topic models, this model is a classic Bayesian parametric model, thus can't overcome the shortcoming of Bayesian parametric models. For example, the number of topics must be specified in advance. Based on this intuition, we extend this model and propose a Bayesian nonparametric model NPSymCorrLDA. Experiments on Chinese-English datasets extracted from Wikipediahttps://zh.wikipedia.org/ show significant improvement over SymCorrLDA.
Correction

DOI: https://doi.org/10.1080/15685551.2020.1795509

2020-08-27

Abstract:[This corrects the article DOI: 10.1163/138577210X12634696333433.][This corrects the article DOI: 10.1163/138577211X577178.].
Latent Topic Model for Image Annotation by Modeling Topic Correlation

Xing Xu,Atsushi Shimada,Rin-ichiro Taniguchi

DOI: https://doi.org/10.1109/icme.2013.6607531

2013-01-01

Abstract:For the task of image annotation, traditional probabilistic topic models based on Latent Dirichlet Allocation (LDA) [1], assume that an image is a mixture of latent topics. An inevitable limitation of LDA is the inability to model topic correlation since topic proportions of an image are generated independently. Motivated by Correlated Topic Model (CTM) [2] which derives from natural language processing to model topic correlation of a document, we extend the popular LDA based models (corrLDA [3], sLDA-bin [4], trmmLDA [5]) to CTM based models (corrCTM, sCTM-bin, trmmCTM). We present a comprehensive comparison between CTM based and LDA based models on three benchmark datasets, illustrating the superior annotation performance of proposed CTM based models, by means of propagating topic correlation among image features and annotation words.
A topic-based Document Correlation Model

XiPing Jia,Hong Peng,QiLun Zheng,ZhuoLin Jiang,Zhao Li

DOI: https://doi.org/10.1109/ICMLC.2008.4620826

2008-01-01

Abstract:Document correlation analysis is now a focus of study in text mining. This paper proposed a Document Correlation Model to capture the correlation between documents from topic level. The model represents the document correlation as the Optimal Matching of a bipartite graph, of which each partition is a document, each node is a topic, and each edge is the similarity between two topics. The topics of each document are retrieved by the Latent Dirichlet Allocation model and Gibbs sampling. Experiments on correlated document search show that the Document Correlation Model outperforms the Vector Space Model on two aspects: 1) it has higher average retrieval precision; 2) it needs less space to store a documentpsilas information.
Correction to "Comparing theories with the Ising model of explanatory coherence" by Maier et al. (2023).

DOI: https://doi.org/10.1037/met0000705

IF: 10.929

2024-09-24

Psychological Methods

Abstract:Reports an error in "Comparing theories with the Ising model of explanatory coherence" by Maximilian Maier, Noah van Dongen and Denny Borsboom ( Psychological Methods , Advanced Online Publication, Mar 02, 2023, np). In the article, the copyright attribution was incorrectly listed, and the Creative Commons CC BY 4.0 license disclaimer was incorrectly omitted from the author note. The correct copyright is "© 2023 The Author(s)," and the omitted disclaimer is below: Open Access funding provided by University College London: This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0; https://creativecommons.org/licenses/by/ 4.0). This license permits copying and redistributing the work in any medium or format, as well as adapting the material for any purpose, even commercially. (The following abstract of the original article appeared in record 2023-50323-001.) Theories are among the most important tools of science. Lewin (1943) already noted "There is nothing as practical as a good theory." Although psychologists discussed problems of theory in their discipline for a long time, weak theories are still widespread in most subfields. One possible reason for this is that psychologists lack the tools to systematically assess the quality of their theories. Thagard (1989) developed a computational model for formal theory evaluation based on the concept of explanatory coherence. However, there are possible improvements to Thagard's (1989) model and it is not available in software that psychologists typically use. Therefore, we developed a new implementation of explanatory coherence based on the Ising model. We demonstrate the capabilities of this new Ising model of Explanatory Coherence (IMEC) on several examples from psychology and other sciences. In addition, we implemented it in the R-package IMEC to assist scientists in evaluating the quality of their theories in practice. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, multidisciplinary
Co-Factor Analysis of Citation Networks

Alex Hayes,Karl Rohe

DOI: https://doi.org/10.1080/10618600.2024.2394464

2024-10-03

Journal of Computational and Graphical Statistics

Abstract:One compelling use of citation networks is to characterize papers by their relationships to the surrounding literature. We propose a method to characterize papers by embedding them into two distinct "co-factor" spaces: one describing how papers send citations, and the other describing how papers receive citations. This approach presents several challenges. First, older documents cannot cite newer documents, and thus it is not clear that co-factors are even identifiable. We resolve this challenge by developing a co-factor model for asymmetric adjacency matrices with missing lower triangles and showing that identification is possible. We then frame estimation as a matrix completion problem and develop a specialized implementation of matrix completion because prior implementations are memory bound in our setting. Simulations show that our estimator has promising finite sample properties, and that naive approaches fail to recover latent co-factor structure. We leverage our estimator to investigate 255,780 papers published in statistics journals from 1898 to 2024, resulting in the most comprehensive topic model of the statistics literature to date. We find interpretable co-factors corresponding to many statistical subfields, including time series, variable selection, spatial methods, graphical models, GLM(M)s, causal inference, multiple testing, quantile regression, semiparametrics, dimension reduction, and several more. Supplementary materials for this article are available online.

statistics & probability
Correction: A Novel Top-k Strategy for Influence Maximization in Complex Networks with Community Structure.

Jia-Lin He,Yan Fu,Duan-Bing Chen

DOI: https://doi.org/10.1371/journal.pone.0162066

IF: 3.7

2016-01-01

PLoS ONE

Abstract:[This corrects the article DOI: 10.1371/journal.pone.0145283.].
Joint Modeling of Topics, Citations, and Topical Authority in Academic Corpora

Jooyeon Kim,Dongwoo Kim,Alice Oh

DOI: https://doi.org/10.48550/arXiv.1706.00593

2017-06-02

Abstract:Much of scientific progress stems from previously published findings, but searching through the vast sea of scientific publications is difficult. We often rely on metrics of scholarly authority to find the prominent authors but these authority indices do not differentiate authority based on research topics. We present Latent Topical-Authority Indexing (LTAI) for jointly modeling the topics, citations, and topical authority in a corpus of academic papers. Compared to previous models, LTAI differs in two main aspects. First, it explicitly models the generative process of the citations, rather than treating the citations as given. Second, it models each author's influence on citations of a paper based on the topics of the cited papers, as well as the citing papers. We fit LTAI to four academic corpora: CORA, Arxiv Physics, PNAS, and Citeseer. We compare the performance of LTAI against various baselines, starting with the latent Dirichlet allocation, to the more advanced models including author-link topic model and dynamic author citation topic model. The results show that LTAI achieves improved accuracy over other similar models when predicting words, citations and authors of publications.

Computation and Language,Digital Libraries,Social and Information Networks
Corruption of the Pearson correlation coefficient by measurement error and its estimation, bias, and correction under different error models

Edoardo Saccenti,Margriet H. W. B. Hendriks,Age K. Smilde

DOI: https://doi.org/10.1038/s41598-019-57247-4

IF: 4.6

2020-01-16

Scientific Reports

Abstract:Abstract Correlation coefficients are abundantly used in the life sciences. Their use can be limited to simple exploratory analysis or to construct association networks for visualization but they are also basic ingredients for sophisticated multivariate data analysis methods. It is therefore important to have reliable estimates for correlation coefficients. In modern life sciences, comprehensive measurement techniques are used to measure metabolites, proteins, gene-expressions and other types of data. All these measurement techniques have errors. Whereas in the old days, with simple measurements, the errors were also simple, that is not the case anymore. Errors are heterogeneous, non-constant and not independent. This hampers the quality of the estimated correlation coefficients seriously. We will discuss the different types of errors as present in modern comprehensive life science data and show with theory, simulations and real-life data how these affect the correlation coefficients. We will briefly discuss ways to improve the estimation of such coefficients.

multidisciplinary sciences
Designing a use-error robust machine learning model for quantitative analysis of diffuse reflectance spectra (Erratum)

Allison Scarbrough,Keke Chen,Bing Yu

DOI: https://doi.org/10.1117/1.jbo.29.11.119801

IF: 3.758

2024-11-28

Journal of Biomedical Optics

Abstract:The erratum documents a correction to the originally published article. The original article was corrected and republished 18 November 2024, doi: https://doi.org/10.1117/1.JBO.29.1.015001.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
Correction To: Bacomics: a Comprehensive Cross Area Originating in the Studies of Various Brain–apparatus Conversations

Dezhong Yao,Yangsong Zhang,Tiejun Liu,Philippe Xu,Diankun Gong,Jing Lu,Yang Xia,Cheng Luo,Daqing Guo,Dong Li,Yongxiu Lai,Ke Chen,Jianfu Li

DOI: https://doi.org/10.1007/s11571-022-09853-8

2022-01-01

Cognitive Neurodynamics

Abstract:[This corrects the article DOI: 10.1007/s11571-020-09577-7.].
Correction: Corrigendum: Length Distribution of Ancestral Tracks under a General Admixture Model and Its Applications in Population History Inference

Ni, Xumin,Yang, Xiong,Guo, Wei,Yuan, Kai,Zhou, Ying,Ma, Zhiming,Xu, Shuhua

DOI: https://doi.org/10.1038/srep26367

IF: 4.6

2015-01-01

Scientific Reports

Abstract:Scientific Reports 6: Article number: 20048; published online: 28 January 2016; updated: 23 May 2016. In the original version of this Article, Affiliation 1 was omitted for Zhiming Ma. This error has now been corrected in the PDF and HTML versions of the Article.

Correction: A correlated topic model of Science

Comparative Study of Chinese-English Scientific Topic Ranking Correlations: Computer Science Perspective

Correlated topic model for image annotation

A Compound Correlation Model for Disjoint Literature-Based Knowledge Discovery (vol 64, pg 423, 2012)

Fast, Flexible Models for Discovering Topic Correlation across Weakly-Related Collections

Correction to “Insights into the Effects of Violating Statistical Assumptions for Dimensionality Reduction for Chemical “-omics” Data with Multiple Explanatory Variables”

Parsimonious Topic Models with Salient Word Discovery

Model Error Correction in Data Assimilation by Integrating Neural Networks

Nonparametric Symmetric Correspondence Topic Models for Multilingual Text Analysis.

Correction

Latent Topic Model for Image Annotation by Modeling Topic Correlation

A topic-based Document Correlation Model

Correction to "Comparing theories with the Ising model of explanatory coherence" by Maier et al. (2023).

Co-Factor Analysis of Citation Networks

Correction: A Novel Top-k Strategy for Influence Maximization in Complex Networks with Community Structure.

Joint Modeling of Topics, Citations, and Topical Authority in Academic Corpora

Corruption of the Pearson correlation coefficient by measurement error and its estimation, bias, and correction under different error models

Designing a use-error robust machine learning model for quantitative analysis of diffuse reflectance spectra (Erratum)

Correction To: Bacomics: a Comprehensive Cross Area Originating in the Studies of Various Brain–apparatus Conversations

Correction: Corrigendum: Length Distribution of Ancestral Tracks under a General Admixture Model and Its Applications in Population History Inference