LightFusionRec: Lightweight Transformers-Based Cross-Domain Recommendation Model

Vansh Kharidia,Dhruvi Paprunia,Prashasti Kanikar
2024-10-21
Abstract:This paper presents LightFusionRec, a novel lightweight cross-domain recommendation system that integrates DistilBERT for textual feature extraction and FastText for genre embedding. Important issues in recommendation systems, such as data sparsity, computational efficiency, and cold start issues, are addressed in methodology. LightFusionRec uses a small amount of information to produce precise and contextually relevant recommendations for many media formats by fusing genre vector embedding with natural language processing algorithms. Tests conducted on extensive movie and book datasets show notable enhancements in suggestion quality when compared to conventional methods. Because of its lightweight design, the model can be used for a variety of purposes and allows for ondevice inference. LightFusionRec is a noteworthy development in cross-domain recommendation systems, providing accurate and scalable recommendations to improve user experience on digital content platforms.
Artificial Intelligence
What problem does this paper attempt to address?
The main problems that this paper attempts to solve are several key challenges in existing recommendation systems, especially those encountered in cross - domain recommendation systems. Specifically, these problems include: 1. **Context Understanding**: - **Challenge**: Existing recommendation systems often fail to capture the subtle context of content descriptions and the semantic relationships between different categories. - **Solution**: By combining the text embeddings generated by DistilBERT and the category vectors generated by FastText, LightFusionRec can capture the meaning of content descriptions and the semantic relationships between categories. 2. **Acquiring Cross - Domain Training Data**: - **Challenge**: Traditional recommendation models require a large amount of cross - domain training data to train recommendation models for the same group of users, which is very difficult in practice. - **Solution**: This model uses context understanding to recommend items without the need for detailed user preferences or paired cross - domain data of user sets for training. 3. **Data Sparsity and Cold - Start Problems**: - **Challenge**: When providing relevant recommendations for new users, traditional recommendation systems often find it difficult to provide effective recommendations due to the lack of interaction history. - **Solution**: LightFusionRec effectively solves the cold - start problem by focusing on the following two parameters: 1. **Content Category**: Represented by category vectors (GV), it helps the model understand the types of movies or items that users may prefer. 2. **Description Similarity**: Uses vector embeddings of content descriptions to discover users' specific interests. For example, if a user likes science - fiction, the model should be able to identify movies of the "alien" type. 4. **Scalability and Efficiency**: - **Challenge**: Balancing computational efficiency while maintaining recommendation quality, especially in device - side applications. - **Solution**: Many traditional recommendation systems, especially those using deep learning, are computationally expensive and usually require cloud infrastructure. LightFusionRec is designed as a lightweight model. By using DistilBERT and pre - computed category embeddings, it can operate efficiently on the device side, providing scalability without sacrificing recommendation quality. In conclusion, LightFusionRec aims to solve the problems of data sparsity, cold - start, and computational efficiency in cross - domain recommendation systems by combining advanced natural language processing techniques and category embeddings, thereby providing more accurate and context - relevant recommendations.