Abstract:Understanding the evolution of knowledge has been and will continue to be the key task of science, technology, and innovation management. Existing research on evolutionary path identification relies primarily on traditional co-occurrence analysis and bag-of-words (BOW)–based models for topic extraction. However, these approaches have limitations in effectively capturing the underlying semantics and linkages of the topics. In this article, we propose a novel embedding-based methodology for scientific evolution analysis, in which word embedding, document embedding, clustering, and network analysis are applied to extract topics, measure topical semantic similarities, and quantitatively distinguish topics’ evolutionary states. We first perform benchmark experiments to demonstrate that doc2vec generally outperforms the BOW-based models in topic extraction before evolution analysis. We then consider topic consistency in vector spaces to identify evolutionary states including newborn, convergence, inheritance, and extinction. Scientific evolutionary paths are finally unraveled based on topic similarity matrixes and evolutionary states. We conduct a case study on object detection research to validate the effectiveness of our methodology. The empirical results, validated by domain experts, demonstrate that the proposed methodology is capable of effectively revealing patterns of knowledge inheritance and integration. Consequently, this methodology can be used to improve decision-making processes in future innovation management.

Subtopic Based Topic Evolution Analysis

Topic Evolution Analysis Based on Cluster Topic Model.

Visual exploration of software evolution via topic modeling

LDA MODEL-BASED NEWS TOPIC EVOLUTION

Identification of topic evolution: network analytics with piecewise linear representation and word embedding

Evolution Analysis of Online Topics Based on ‘Word-Topic’ Coupling Network

LDA Topic Evolution Based on Global and Local Modeling

Topic Network Analysis Based on Co-Occurrence Time Series Clustering

Analyzing Topic-Sentiment and Topic Evolution over Time from Social Media.

Modeling the Evolution of Associated Data

Unraveling Scientific Evolutionary Paths: an Embedding-Based Topic Analysis

Semantic-enhanced topic evolution analysis: a combination of the dynamic topic model and word2vec

Modeling Dynamic Topics in Chain-Free Fashion by Evolution-Tracking Contrastive Learning and Unassociated Word Exclusion

How Hierarchical Topics Evolve in Large Text Corpora.

Detecting Community and Topic Co-Evolution in Social Networks

Tracking the evolution of social emotions with topic models

Timeline Generation Through Evolutionary Trans-Temporal Summarization

Textflow: Towards Better Understanding of Evolving Topics in Text

Topic evolution based on the probabilistic topic model: a review

A LDA Based Model for Topic Evolution: Evidence from Information Science Journals

A Novel Emerging Topic Identification and Evolution Discovery Method on Time-Evolving and Heterogeneous Online Social Networks