A hybrid machine learning framework for analyzing human decision making through learning preferences

Mengzhuo Guo,Qingpeng Zhang,Xiuwu Liao,Frank Youhua Chen,Daniel Dajun Zeng
DOI: https://doi.org/10.48550/arXiv.1906.01233
2019-10-25
Abstract:Machine learning has recently been widely adopted to address the managerial decision making problems, in which the decision maker needs to be able to interpret the contributions of individual attributes in an explicit form. However, there is a trade-off between performance and interpretability. Full complexity models are non-traceable black-box, whereas classic interpretable models are usually simplified with lower accuracy. This trade-off limits the application of state-of-the-art machine learning models in management problems, which requires high prediction performance, as well as the understanding of individual attributes' contributions to the model outcome. Multiple criteria decision aiding (MCDA) is a family of analytic approaches to depicting the rationale of human decision. It is also limited by strong assumptions. To meet the decision maker's demand for more interpretable machine learning models, we propose a novel hybrid method, namely Neural Network-based Multiple Criteria Decision Aiding, which combines an additive value model and a fully-connected multilayer perceptron (MLP) to achieve good performance while capturing the explicit relationships between individual attributes and the prediction. NN-MCDA has a linear component to characterize such relationships through providing explicit marginal value functions, and a nonlinear component to capture the implicit high-order interactions between attributes and their complex nonlinear transformations. We demonstrate the effectiveness of NN-MCDA with extensive simulation studies and three real-world datasets. To the best of our knowledge, this research is the first to enhance the interpretability of machine learning models with MCDA techniques. The proposed framework also sheds light on how to use machine learning techniques to free MCDA from strong assumptions.
Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to improve the interpretability of machine - learning models while maintaining high prediction performance in management decision - making. Specifically, the paper focuses on how to combine multi - criteria decision - making assistance (MCDA) techniques with machine - learning models to overcome the trade - off between interpretability and prediction performance in existing models. Traditionally, complex machine - learning models such as neural networks have high prediction performance but lack interpretability; while classic interpretable models such as logistic regression are overly simplified and have lower prediction performance. To meet decision - makers' needs for more interpretable machine - learning models, the paper proposes a new hybrid method - neural - network - based multi - criteria decision - making assistance (NN - MCDA), aiming to achieve good performance by combining the additive value model and the fully - connected multi - layer perceptron (MLP) and capture the explicit relationship between individual attributes and predictions. ### Main contributions of the paper: 1. **Hybrid model**: A new hybrid machine - learning model is proposed, which not only quantifies the explicit impact of individual attributes on the results but also captures the implicit high - order correlations between attributes. This helps decision - makers understand the main effects of single attributes and make better decisions at the same time. 2. **Introduction of MCDA**: The preference decomposition method based on the value function is introduced into the machine - learning model for the first time to enhance the interpretability of the model. The trained parameters determine the shape of the marginal value function in the additive model, making the model free from the strong assumptions in the MCDA method (such as preference independence, preference monotonicity and small learning set assumptions), making it more general and practical. 3. **Model validity verification**: The effectiveness of the proposed model is verified through a series of synthetic data sets and experiments on three real - data sets. The research results show that the model performs well under different parameter settings and data sets, and the relationship between the interpretability of the model and data complexity has intuitive management significance for decision - makers. 4. **Flexibility and extensibility**: The proposed framework is flexible and extensible. In particular, the nonlinear part can be modified or replaced with other network structures or modeling schemes to meet different task requirements. ### Model framework: - **Additive model**: The marginal value function is used to approximate the explicit relationship between the results and individual attributes. The marginal value function can be in a nonlinear and non - monotonic form, which can better fit the complex relationship between attributes and results. - **Neural network model**: The fully - connected multi - layer perceptron (MLP) is used to capture the implicit high - order correlations between attributes. By adjusting the weight \(\alpha\) to balance the contributions between the additive model and the MLP, the interpretability of the model can be improved while maintaining high performance. ### Application scenarios: - **University ranking**: Rank universities according to their employment reputation. - **Elderly depression risk prediction**: Predict the risk of depression in the elderly. - **Bank telemarketing success prediction**: Predict the success rate of bank telemarketing. Through these application scenarios, the paper demonstrates the effectiveness and practicality of the NN - MCDA model in actual management problems.