Proactive Detractor Detection Framework Based on Message-Wise Sentiment Analysis Over Customer Support Interactions

Juan Sebastián Salcedo Gallo,Jesús Solano,Javier Hernán García,David Zarruk-Valencia,Alejandro Correa-Bahnsen
2022-11-08
Abstract:In this work, we propose a framework relying solely on chat-based customer support (CS) interactions for predicting the recommendation decision of individual users. For our case study, we analyzed a total number of 16.4k users and 48.7k customer support conversations within the financial vertical of a large e-commerce company in Latin America. Consequently, our main contributions and objectives are to use Natural Language Processing (NLP) to assess and predict the recommendation behavior where, in addition to using static sentiment analysis, we exploit the predictive power of each user's sentiment dynamics. Our results show that, with respective feature interpretability, it is possible to predict the likelihood of a user to recommend a product or service, based solely on the message-wise sentiment evolution of their CS conversations in a fully automated way.
Machine Learning,Information Retrieval
What problem does this paper attempt to address?
The paper aims to address the following issues: 1. **Predicting User Recommendation Behavior**: By analyzing the emotional dynamics in Customer Support (CS) chat logs, the study aims to predict users' recommendation decisions (i.e., whether users will recommend a product or service). The research utilizes Natural Language Processing (NLP) techniques to evaluate and predict user recommendation behavior. 2. **Emotional Dynamics Analysis**: In addition to static sentiment analysis, the study also leverages the emotional dynamics of each user within specific conversations to improve prediction accuracy. This approach better captures the actual emotional changes of users and predicts their recommendation behavior accordingly. 3. **Addressing Limitations of Existing Methods**: Previous research has focused on data sources such as online reviews and social media data, which are non-chat forms. This paper attempts to fill this gap by systematically analyzing the predictive power of emotional dynamics based on chat logs for the first time. Specifically, the researchers propose a framework that predicts user recommendation behavior in advance by analyzing the emotional dynamics in large-scale e-commerce company customer support chat logs. Experimental results show that message-level emotional dynamics analysis can more effectively predict individual user recommendation behavior compared to traditional overall sentiment analysis methods. Additionally, the study explores the importance of different features and demonstrates the flexibility and interpretability of the model in practical applications.