Abstract:Reciprocal recommender systems~(RRS), conducting bilateral recommendations between two involved parties, have gained increasing attention for enhancing matching efficiency. However, the majority of existing methods in the literature still reuse conventional ranking metrics to separately assess the performance on each side of the recommendation process. These methods overlook the fact that the ranking outcomes of both sides collectively influence the effectiveness of the RRS, neglecting the necessity of a more holistic evaluation and a capable systemic solution. In this paper, we systemically revisit the task of reciprocal recommendation, by introducing the new metrics, formulation, and method. Firstly, we propose five new evaluation metrics that comprehensively and accurately assess the performance of RRS from three distinct perspectives: overall coverage, bilateral stability, and balanced ranking. These metrics provide a more holistic understanding of the system's effectiveness and enable a comprehensive evaluation. Furthermore, we formulate the RRS from a causal perspective, formulating recommendations as bilateral interventions, which can better model the decoupled effects of potential influencing factors. By utilizing the potential outcome framework, we further develop a model-agnostic causal reciprocal recommendation method that considers the causal effects of recommendations. Additionally, we introduce a reranking strategy to maximize matching outcomes, as measured by the proposed metrics. Extensive experiments on two real-world datasets from recruitment and dating scenarios demonstrate the effectiveness of our proposed metrics and approach. The code and dataset are available at: <a class="link-external link-https" href="https://github.com/RUCAIBox/CRRS" rel="external noopener nofollow">this https URL</a>.

AND: Effective Coupling of Accuracy, Novelty and Diversity in the Recommender System

Covering Diversification and Fairness for Better Recommendation (Short Paper).

Towards Unified Metrics for Accuracy and Diversity for Recommender Systems

How good your recommender system is? A survey on evaluations in recommendation

On Evaluation Metrics for Diversity-enhanced Recommendations

Solving the Apparent Diversity-Accuracy Dilemma of Recommender Systems

Improving Recommendation Accuracy and Diversity Via Multiple Social Factors and Social Circles

Revisiting Reciprocal Recommender Systems: Metrics, Formulation, and Method

A Novel Framework for Improving Recommender Diversity.

Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation

Evaluation Metrics for Personalized Recommendation Systems

Adaptive recommendation systems: A comparative analysis of KNN-based algorithms and hybrid models

A Hybrid Recommender System Based on User-Recommender Interaction

An Adjustable Re-Ranking Approach for Improving the Individual and Aggregate Diversities of Product Recommendations

A New Collaborative Filtering Technique to Improve Recommendation Diversity

The effect of rating variance on personalized recommendation

Enhancing the long-term performance of recommender system

NNIA-RS: A multi-objective optimization based recommender system

Adaptive Social Recommendation in a Multiple Category Landscape

A Synthetic Approach for Recommendation: Combining Ratings, Social Relations, and Reviews

Are We Evaluating Rigorously? Benchmarking Recommendation for Reproducible Evaluation and Fair Comparison