Abstract:Predicting how a user responds to news events enables important applications such as allowing intelligent agents or content producers to estimate the effect on different communities and revise unreleased messages to prevent unexpected bad outcomes such as social conflict and moral injury. We present a new task, Response Forecasting on Personas for News Media, to estimate the response a persona (characterizing an individual or a group) might have upon seeing a news message. Compared to the previous efforts which only predict generic comments to news, the proposed task not only introduces personalization in the modeling but also predicts the sentiment polarity and intensity of each response. This enables more accurate and comprehensive inference on the mental state of the persona. Meanwhile, the generated sentiment dimensions make the evaluation and application more reliable. We create the first benchmark dataset, which consists of 13,357 responses to 3,847 news headlines from Twitter. We further evaluate the SOTA neural language models with our dataset. The empirical results suggest that the included persona attributes are helpful for the performance of all response dimensions. Our analysis shows that the best-performing models are capable of predicting responses that are consistent with the personas, and as a byproduct, the task formulation also enables many interesting applications in the analysis of social network groups and their opinions, such as the discovery of extreme opinion groups.

Overview of the NLPCC 2023 Shared Task 9: User Feedback Prediction and Response Generation.

Overview of the NLPCC 2023 Shared Task 10: Learn to Watch TV: Multimodal Dialogue Understanding and Response Generation.

Overview of the NLPCC 2018 Shared Task: Multi-turn Human-Computer Conversations.

Overview of the NLPCC 2017 Shared Task: Emotion Generation Challenge

NLPCC 2018 Shared Task User Profiling and Recommendation Method Summary by DUTIR_9148.

Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation

Overview of the NLPCC 2022 Shared Task: Multi-modal Dialogue Understanding and Generation

Generating Empathetic Responses by Looking Ahead the User's Sentiment

Response-conditioned Turn-taking Prediction

Overview of the NLPCC 2018 Shared Task: Social Media User Modeling

PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Prediction

Generating Dialogue Responses with Latent Lexical Meaning

Group Linguistic Bias Aware Neural Response Generation.

Predicting Users' Negative Feedbacks in Multi-Turn Human-Computer Dialogues.

Measuring the Effect of Influential Messages on Varying Personas

Overview of the NLPCC-ICCPOL 2017 Shared Task: Social Media User Modeling

EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization

Overview of the NLPCC 2022 Shared Task: Dialogue Text Analysis (DTA)

The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values

NewsDialogues: Towards Proactive News Grounded Conversation.

Learning from Negative User Feedback and Measuring Responsiveness for Sequential Recommenders