Abstract:Recently, topic modeling-based source code comprehension has become one of the research hotspots. Researchers mine functional topics from source code with topic modeling techniques, and use these functional topics to help developers comprehend the functional concerns of a software system and the corresponding implementations in source code. However, because diverse kinds of topics, including functional topics and other noisy topics, are mixed together in the raw topics mined from source code, developers have to identify functional topics manually. The manual identification process is difficult and time-consuming due to the fact that only basic information (e.g. associated words) is provided by previous approaches. In this paper, we propose a topic modeling and static analysis-based approach to obtain functional topics from source code. Firstly, we execute source code preprocessing with a series of Filtering Heuristics, and then mine raw topics from source code using topic modeling techniques. Then, we conduct static analysis on source code to obtain structural relationships, based on which we propose a novel metric called Topic Cohesion to identify functional topics from the raw topics. Finally, we locate source code elements that implement the topics, and generate topic descriptions using source code comments for the developers to comprehend the topics. Experiments on a set of open source software show that our approach can effectively obtain functional topics and their associated information, which helps developer comprehend the functional concerns of a software system and the corresponding implementations in source code.

Mining Cohesive Domain Topics from Source Code

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Obtaining Functional Topics from Source Code Based on Topic Modeling and Static Analysis

Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

Improving Automated Bug Triaging with Specialized Topic Model.

Toward Summary Extraction Method for Functional Topic

Discriminative Topic Mining via Category-Name Guided Text Embedding

Research on Mining Common Concern Via Infinite Topic Modelling

Topic Modeling in Semantic Space with Keywords.

Using Topic Modeling for Code Discovery in Large Scale Text Data

Mining common topics from multiple asynchronous text streams.

MIT: Mutual Information Topic Model for Diverse Topic Extraction

Query Subtopic Mining Via Subtractive Initialization of Non-negative Sparse Latent Semantic Analysis

"Draw My Topics": Find Desired Topics fast from large scale of Corpus

Topics Modeling Based on Selective Zipf Distribution

Topic Mining over Asynchronous Text Sequences

Topic Discovery for Streaming Short Texts with CTM.

Domain-specific Topic Model for Knowledge Discovery in Computational and Data-Intensive Scientific Communities

Extensible Topic Modeling and Analysis Framework for Multisource Data*

News Topic Discovery Through Community Detection

Topic Mining on Web-Shared Videos