Adaptation of XAI to Auto-tuning for Numerical Libraries

Shota Aoki,Takahiro Katagiri,Satoshi Ohshima,Masatoshi Kawai,Toru Nagai,Tetsuya Hoshino
2024-05-12
Abstract:Concerns have arisen regarding the unregulated utilization of artificial intelligence (AI) outputs, potentially leading to various societal issues. While humans routinely validate information, manually inspecting the vast volumes of AI-generated results is impractical. Therefore, automation and visualization are imperative. In this context, Explainable AI (XAI) technology is gaining prominence, aiming to streamline AI model development and alleviate the burden of explaining AI outputs to users. Simultaneously, software auto-tuning (AT) technology has emerged, aiming to reduce the man-hours required for performance tuning in numerical calculations. AT is a potent tool for cost reduction during parameter optimization and high-performance programming for numerical computing. The synergy between AT mechanisms and AI technology is noteworthy, with AI finding extensive applications in AT. However, applying AI to AT mechanisms introduces challenges in AI model explainability. This research focuses on XAI for AI models when integrated into two different processes for practical numerical computations: performance parameter tuning of accuracy-guaranteed numerical calculations and sparse iterative algorithm.
Software Engineering,Artificial Intelligence,Machine Learning,Mathematical Software
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to optimize the auto - tuning (AT) process of numerical computing libraries by combining Explainable AI (XAI) techniques. Specifically, the research aims to address the following issues: 1. **Automated verification and reduction of human intervention**: - With the wide application of artificial intelligence (AI) in various fields, how to ensure the accuracy and reliability of AI output results has become an urgent problem. Manually reviewing a large number of AI - generated results is impractical, so automated methods are needed to verify these results and reduce the need for human intervention. 2. **Improve the performance tuning efficiency of numerical computing libraries**: - Performance tuning of numerical computing libraries is usually a time - consuming and labor - intensive task. By introducing AI techniques, the manpower and time costs required for performance tuning can be significantly reduced. However, applying AI to the AT mechanism brings the challenge of model interpretability, that is, how to make the decision - making process of the AI model transparent so that users can understand and trust its results. 3. **Optimize parameter selection for high - precision matrix operations and sparse iterative algorithms**: - The research focuses on using XAI techniques to optimize two different numerical computing processes: one is high - precision matrix multiplication (such as the Ozaki method), and the other is the sparse iterative solver (such as the PICCG method). Specifically, the research attempts to improve the efficiency and accuracy of these computing processes by automatically selecting the best implementation methods and parameter settings. ### Main contributions of the paper - **Combination of XAI and AT**: The paper proposes a new method of applying XAI techniques to the AT mechanism to improve the interpretability and credibility of AI models. - **Specific application scenarios**: Through two specific cases - high - precision matrix multiplication and sparse iterative solver, it shows how to use XAI tools (such as SHAP) to optimize the selection of performance parameters. - **Experimental verification**: Through a large number of experimental results, it proves the effectiveness of the proposed method and shows the important role of XAI in enhancing the AI - assisted AT process. ### Formula examples Some of the formulas involved in the paper are as follows: - **Matrix decomposition in the Ozaki method**: \[ A = A^{(1)}+A^{(2)}+A^{(3)}+\cdots +A^{(p)} \] \[ B = B^{(1)}+B^{(2)}+B^{(3)}+\cdots +B^{(q)} \] - **Calculation of matrix multiplication**: \[ AB=(A^{(1)}+A^{(2)}+A^{(3)}+\cdots +A^{(p)})(B^{(1)}+B^{(2)}+B^{(3)}+\cdots +B^{(q)}) \] \[ =A^{(1)}B^{(1)}+A^{(2)}B^{(1)}+\cdots +A^{(p)}B^{(q)} \] - **IC decomposition**: \[ A = U^{T}DU + R \] where \(U\) is an upper triangular matrix, \(D\) is a diagonal matrix, and \(R\) is a residual matrix. Through these formulas and methods, the paper successfully shows how to use XAI techniques to optimize the auto - tuning process of numerical computing libraries, thereby improving computational efficiency and the interpretability of results.