Self-attention Perceptron Personalized Recommendation Model with Automatic Feature Correlation

Wei Zhang,Yahui Han,Xiaoxuan Shen,Baolin Yi,Zhaoli Zhang
DOI: https://doi.org/10.1117/12.2628566
2022-01-01
Abstract:How to automatically obtain cross-features with different weight values is a significant issue in the research of recommendation models. Traditional recommendation models cannot automatically learn the deep-level features of users and items to obtain cross-features. The mixed processing of dense numerical features and sparse categorical features will result in more information loss during dimensionality reduction. Cross features occupy the same weight in the recommendation process, which will lead to the non-prominence of critical features and reduce the accuracy of model recommendations. This paper proposes a personalized recommendation model (MSRN) for self-attention perceptron with automatic feature correlation. The model first processes the numerical features and category features in double towers to reduce the loss of feature information. Numerical cross-feature matrix and category cross-feature matrix use multilayer perceptrons to automatically mine the hidden knowledge and relationships between features. The model uses the Hadamard product to process it to obtain the cross feature matrix and uses the self-attention mechanism to assign different weights to the extracted cross-features. The experimental results on the public data set show that the recommended evaluation indicators of this model, MAE, and RMSE, are better than the current advanced recommendation models and have better accuracy and stability.
What problem does this paper attempt to address?