Temporal dynamics of user activities: deep learning strategies and mathematical modeling for long-term and short-term profiling

Mohammed Kayed,Fatima Azzam,Hussien Ali,Abdelmgied Ali

DOI: https://doi.org/10.1038/s41598-024-64120-6

IF: 4.6

2024-06-26

Scientific Reports

Abstract:Profiling social media users is an analytical approach to generate an extensive blueprint of user's personal characteristics, which can be useful for a diverse range of applications, such as targeted marketing and personalized recommendations. Although social user profiling has gained substantial attention in recent years, effectively constructing a collaborative model that could describe long and short-term profiles is still challenging. In this paper, we will discuss the profiling problem from two perspectives; how to mathematically model and track user's behavior over short and long periods and how to enhance the classification of user's activities. Using mathematical equations, our model can define periods in which the user's interests abruptly changed. A dataset consisting of 30,000 tweets was built and manually annotated into 10 topic categories. Bi-LSTM and GRU models are applied to classify the user's activities representing his interests, which then are utilized to create and model the dynamic profile. In addition, the effect of word embedding techniques and pre-trained classification models on the accuracy of the classification process is explored in this research.

multidisciplinary sciences

What problem does this paper attempt to address?

The problems that this paper attempts to solve are:

1. **How to construct a collaborative model that can describe both short - term and long - term user portraits**: Although current social user portraits have received extensive attention, effectively constructing a model that can describe both long - term and short - term portraits is still challenging. The paper explores methods to solve the problem from two perspectives: how to track short - term and long - term behavior changes of users through mathematical modeling, and how to improve the accuracy of user activity classification.

2. **How to detect changes in user behavior within a specific period**: The paper proposes a technique that can identify the periods when users' interests change suddenly. This helps to understand users' dynamic behavior patterns and adjust user portraits in a timely manner.

3. **How to improve the classification process for classifying different activities of users to better construct user portraits**: The paper proposes using Bidirectional Long - Short - Term Memory Network (Bi - LSTM) and Gated Recurrent Unit (GRU) models to classify user activities, which represent users' interests. In addition, it also studies the influence of word embedding techniques and pre - trained classification models on classification accuracy.

To answer these questions, the paper takes the following measures:
- Introduces a mathematical model for creating long - term and short - term portraits of social media users.
- Proposes a technique for tracking changes in user behavior.
- Proposes two Recurrent Neural Network (RNN) models to classify user activities.
- Studies the influence of combining pre - trained word embedding techniques (such as FastText and GloVe) with RNN models on classification accuracy.
- Tries to achieve higher classification accuracy by fine - tuning the BERT model as a classifier.

Through these methods, the paper aims to provide a more comprehensive and accurate user portrait construction scheme, thereby providing a better user experience in areas such as personalized recommendations and targeted advertising.