A Data-Driven Approach for Finding Requirements Relevant Feedback from TikTok and YouTube

Manish Sihag,Ze Shi Li,Amanda Dash,Nowshin Nawar Arony,Kezia Devathasan,Neil Ernst,Alexandra Albu,Daniela Damian

2023-07-25

Abstract:The increasing importance of videos as a medium for engagement, communication, and content creation makes them critical for organizations to consider for user feedback. However, sifting through vast amounts of video content on social media platforms to extract requirements-relevant feedback is challenging. This study delves into the potential of TikTok and YouTube, two widely used social media platforms that focus on video content, in identifying relevant user feedback that may be further refined into requirements using subsequent requirement generation steps. We evaluated the prospect of videos as a source of user feedback by analyzing audio and visual text, and metadata (i.e., description/title) from 6276 videos of 20 popular products across various industries. We employed state-of-the-art deep learning transformer-based models, and classified 3097 videos consisting of requirements relevant information. We then clustered relevant videos and found multiple requirements relevant feedback themes for each of the 20 products. This feedback can later be refined into requirements artifacts. We found that product ratings (feature, design, performance), bug reports, and usage tutorial are persistent themes from the videos. Video-based social media such as TikTok and YouTube can provide valuable user insights, making them a powerful and novel resource for companies to improve customer-centric development.

Human-Computer Interaction,Software Engineering

What problem does this paper attempt to address?

The paper primarily explores how to utilize video social media (particularly TikTok and YouTube) to identify user feedback information associated with product demand. Specifically, the research aims to:

1. **Develop a data-driven approach** to extract demand-related information from videos. This approach involves analyzing audio, visual text, and metadata (such as descriptions and titles) in the videos.

2. **Identify major user feedback themes**, which can be extracted from video content and further translated into product demands.

3. **Compare the impact of different social media platforms and their video content** on user feedback, to understand how videos on platforms like YouTube and TikTok influence the content and nature of user feedback.

Through this research, the authors hope to demonstrate the value of video social media as a significant resource for collecting user feedback and propose a method to analyze video data using natural language processing (NLP) and machine learning techniques. The research findings indicate that audio content in videos is particularly important for extracting meaningful user feedback, and deep learning models like GPT-2 and RoBERTa perform excellently in classifying audio and visual content.

In summary, this study aims to explore how to effectively obtain valuable information about user needs from video social media, which is crucial for improving product development processes and enhancing customer satisfaction.