Abstract:Stack Overflow is often viewed as the most influential Software Question Answer (SQA) website with millions of programming-related questions and answers. Tags play a critical role in efficiently structuring the contents in Stack Overflow and are vital to support a range of site operations, e.g., querying relevant contents. Poorly selected tags often introduce extra noise and redundancy, which leads to tag synonym and tag explosion problems. Thus, an automated tag recommendation technique that can accurately recommend high-quality tags is desired to alleviate the problems mentioned above. Inspired by the recent success of pre-trained language models (PTMs) in natural language processing (NLP), we present PTM4Tag, a tag recommendation framework for Stack Overflow posts that utilize PTMs with a triplet architecture, which models the components of a post, i.e., Title, Description, and Code with independent language models. To the best of our knowledge, this is the first work that leverages PTMs in the tag recommendation task of SQA sites. We comparatively evaluate the performance of PTM4Tag based on five popular pre-trained models: BERT, RoBERTa, ALBERT, CodeBERT, and BERTOverflow. Our results show that leveraging the software engineering (SE) domain-specific PTM CodeBERT in PTM4Tag achieves the best performance among the five considered PTMs and outperforms the state-of-the-art deep learning (Convolutional Neural Network-based) approach by a large margin in terms of average $Precision@k$, $Recall@k$, and $F1$-$score@k$. We conduct an ablation study to quantify the contribution of a post's constituent components (Title, Description, and Code Snippets) to the performance of PTM4Tag. Our results show that Title is the most important in predicting the most relevant tags, and utilizing all the components achieves the best performance.

Tag Recommendation for Online Q&A Communities based on BERT Pre-Training Technique

Tag recommendation in software information sites

TagCombine: Recommending Tags to Contents in Software Information Sites

PTM4Tag: Sharpening Tag Recommendation of Stack Overflow Posts with Pre-trained Models

PTM4Tag+: Tag Recommendation of Stack Overflow Posts with Pre-trained Models

Modeling Tag Prediction based on Question Tagging Behavior Analysis of CommunityQA Platform Users

Tag Recommendation Based on Bayesian Principle

Hybrid Recommendation Algorithm Based On Two Roles Of Social Tags

Graph-Based Recommendation System Enhanced with Community Detection

Integrating Multi-level Tag Recommendation with External Knowledge Bases for Automatic Question Answering

Personalized Tag Recommendation Using Graph-Based Ranking on Multi-Type Interrelated Objects

Retrieval Augmented Cross-Modal Tag Recommendation in Software Q&A Sites

Tag-aware Recommender Systems: a State-of-the-art Survey

Hybrid Recommendation Model Based on Social Media and Social Networks

HTRM: A Hybrid Neural Network Algorithm based on Tag-aware

A Tag Recommendation System Based on Contents.

Learning to Tag.

TagTag: A Novel Framework for Service Tags Recommendation and Missing Tag Prediction

Textual tag recommendation with multi-tag topical attention

Bringing the Associative Ability to Social Tag Recommendation.

Document Recommendation in Social Tagging Services