Abstract:Explainable recommendation systems are important to enhance transparency, accuracy, and fairness. Beyond result-level explanations, model-level interpretations can provide valuable insights that allow developers to optimize system designs and implement targeted improvements. However, most current approaches depend on specialized model designs, which often lack generalization capabilities. Given the various kinds of recommendation models, existing methods have limited ability to effectively interpret them. To address this issue, we propose RecSAE, an automatic, generalizable probing method for interpreting the internal states of Recommendation models with Sparse AutoEncoder. RecSAE serves as a plug-in module that does not affect original models during interpretations, while also enabling predictable modifications to their behaviors based on interpretation results. Firstly, we train an autoencoder with sparsity constraints to reconstruct internal activations of recommendation models, making the RecSAE latents more interpretable and monosemantic than the original neuron activations. Secondly, we automated the construction of concept dictionaries based on the relationship between latent activations and input item sequences. Thirdly, RecSAE validates these interpretations by predicting latent activations on new item sequences using the concept dictionary and deriving interpretation confidence scores from precision and recall. We demonstrate RecSAE's effectiveness on two datasets, identifying hundreds of highly interpretable concepts from pure ID-based models. Latent ablation studies further confirm that manipulating latent concepts produces corresponding changes in model output behavior, underscoring RecSAE's utility for both understanding and targeted tuning recommendation models. Code and data are publicly available at <a class="link-external link-https" href="https://github.com/Alice1998/RecSAE" rel="external noopener nofollow">this https URL</a>.

Embedding-based Semantic Analysis Approach: A Preliminary Study on Redundancy Detection in Psychological Concepts Operationalized by Scales

Semantic Annotation with RescoredESA

Reliability Analysis of Psychological Concept Extraction and Classification in User-penned Text

Redundancy and Concept Analysis for Code-trained Language Models

Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Models

Latent Semantic Scaling: A Semisupervised Text Analysis Technique for New Domains and Languages

Revealing the Importance of Semantic Retrieval for Machine Reading at Scale

ConceptPsy:A Benchmark Suite with Conceptual Comprehensiveness in Psychology

Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models

Concept Embedding Analysis: A Review

Scaling Concept With Text-Guided Diffusion Models

A comprehensive empirical analysis on cross-domain semantic enrichment for detection of depressive language

Semantic projection: recovering human knowledge of multiple, distinct object features from word embeddings

Interpreting Embedding Spaces by Conceptualization

Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning

Automated semantic relevance as an indicator of cognitive decline: Out-of-sample validation on a large-scale longitudinal dataset

Interpret the Internal States of Recommendation Model with Sparse Autoencoder

Artificial Intelligence Psychological Anthropomorphism: Scale Development and Validation

Semantic Similarity Models for Depression Severity Estimation

RedTest: Towards Measuring Redundancy in Deep Neural Networks Effectively

A Comparative Study on Structural and Semantic Properties of Sentence Embeddings