Abstract:Code Community Question Answering (CCQA) seeks to tackle programming-related issues, thereby boosting productivity in both software engineering and academic research. Recent advancements in Reinforcement Learning from Human Feedback (RLHF) have transformed the fine-tuning process of Large Language Models (LLMs) to produce responses that closely mimic human behavior. Leveraging LLMs with RLHF for practical CCQA applications has thus emerged as a promising area of study. Unlike standard code question-answering tasks, CCQA involves multiple possible answers, with varying user preferences for each response. Additionally, code communities often show a preference for new APIs. These challenges prevent LLMs from generating responses that cater to the diverse preferences of users in CCQA tasks. To address these issues, we propose a novel framework called Aligning LLMs through Multi-perspective User Preference Ranking-based Feedback for Programming Question Answering (ALMupQA) to create user-focused responses. Our approach starts with Multi-perspective Preference Ranking Alignment (MPRA), which synthesizes varied user preferences based on the characteristics of answers from code communities. We then introduce a Retrieval-augmented In-context Learning (RIL) module to mitigate the problem of outdated answers by retrieving responses to similar questions from a question bank. Due to the limited availability of high-quality, multi-answer CCQA datasets, we also developed a dataset named StaCCQA from real code communities. Extensive experiments demonstrated the effectiveness of the ALMupQA framework in terms of accuracy and user preference. Compared to the base model, ALMupQA showed nearly an 11% improvement in BLEU, with increases of 20% and 17.5% in BERTScore and CodeBERTScore, respectively.

LOCI: A Mobile Q&A System with Multimodal Motivation Scheme for Local Intent Questions in Dynamic Social Networks

Understanding User Behavior of Asking Location-Based Questions on Microblogs

Toward Personalized Activity Level Prediction in Community Question Answering Websites

SORT: SOcial HelpeR SelecTion Scheme for Mobile Question Answering Systems

Optimal Question Answering Routing In Dynamic Online Social Networks

SOQAS: Distributively Finding High-Quality Answerers in Dynamic Social Networks.

Question Retrieval for Community-Based Question Answering Via Heterogeneous Social Influential Network.

Knn Processing with Co-Space Distance in SoLoMo Systems

Crowd-Answering System Via Microblogging

Community-Based Question Answering Via Heterogeneous Social Network Learning

LSTAloc: A Driver-Oriented Incentive Mechanism for Mobility-on-Demand Vehicular Crowdsensing Market

SmartSource: A Mobile Q&A Middleware Powered by Crowdsourcing.

CoQ:AN Empirical Framework for Multi-hop Question Answering Empowered by Large Language Models

Context-Aware Point-of-Interest Recommendation Algorithm with Interpretability.

Aligning LLMs through Multi-perspective User Preference Ranking-based Feedback for Programming Question Answering

Question Answering System Based on Community QA

Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialog

Personalized Question Routing Via Heterogeneous Network Embedding.

Interactive Natural Language-based Person Search

An Interactive Multi-modal Query Answering System with Retrieval-Augmented Large Language Models

A personalized point-of-interest recommendation system for O2O commerce