Abstract:Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area. Recent progress on interpretable ranking models largely focuses on generating post-hoc explanations for existing black-box ranking models, whereas the alternative option of building an intrinsically interpretable ranking model with transparent and self-explainable structure remains unexplored. Developing fully-understandable ranking models is necessary in some scenarios (e.g., due to legal or policy constraints) where post-hoc methods cannot provide sufficiently accurate explanations. In this paper, we lay the groundwork for intrinsically interpretable learning-to-rank by introducing generalized additive models (GAMs) into ranking tasks. Generalized additive models (GAMs) are intrinsically interpretable machine learning models and have been extensively studied on regression and classification tasks. We study how to extend GAMs into ranking models which can handle both item-level and list-level features and propose a novel formulation of ranking GAMs. To instantiate ranking GAMs, we employ neural networks instead of traditional splines or regression trees. We also show that our neural ranking GAMs can be distilled into a set of simple and compact piece-wise linear functions that are much more efficient to evaluate with little accuracy loss. We conduct experiments on three data sets and show that our proposed neural ranking GAMs can achieve significantly better performance than other traditional GAM baselines while maintaining similar interpretability.

Generalized Groves of Neural Additive Models: Pursuing transparent and accurate machine learning models in finance

Monotonic Neural Additive Models: Pursuing Regulated Machine Learning Models for Credit Scoring

How to address monotonicity for model risk management?

How Interpretable and Trustworthy are GAMs?

GAM(e) changer or not? An evaluation of interpretable machine learning models based on additive model constraints

Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models

Interpretability in Safety-Critical FinancialTrading Systems

Scalable Interpretability via Polynomials

Cracking the Black Box: Distilling Deep Sports Analytics

Interpretable Learning-to-Rank with Generalized Additive Models

GAMI-Net: An Explainable Neural Network based on Generalized Additive Models with Structured Interactions

MANE: Model-Agnostic Non-linear Explanations for Deep Learning Model

GAM(L)A: An econometric model for interpretable Machine Learning

Interpretability in deep learning for finance: a case study for the Heston model

Explainable generalized additive neural networks with independent neural network training

Neural Partially Linear Additive Model

Algorithms for interpretable machine learning

GAM Changer: Editing Generalized Additive Models with Interactive Visualization

NeuralFactors: A Novel Factor Learning Approach to Generative Modeling of Equities

Accurate and Intuitive Contextual Explanations using Linear Model Trees

Model-Agnostic Interpretation Framework in Machine Learning: A Comparative Study in NBA Sports