Abstract:Black-box models, such as deep neural networks, exhibit superior predictive performances, but understanding their behavior is notoriously difficult. Many explainable artificial intelligence methods have been proposed to reveal the decision-making processes of black box models. However, their applications in high-stakes domains remain limited. Recently proposed neural additive models (NAM) have achieved state-of-the-art interpretable machine learning. NAM can provide straightforward interpretations with slight performance sacrifices compared with multi-layer perceptron. However, NAM can only model 1$^{\text{st}}$-order feature interactions; thus, it cannot capture the co-relationships between input features. To overcome this problem, we propose a novel interpretable machine learning method called higher-order neural additive models (HONAM) and a feature interaction method for high interpretability. HONAM can model arbitrary orders of feature interactions. Therefore, it can provide the high predictive performance and interpretability that high-stakes domains need. In addition, we propose a novel hidden unit to effectively learn sharp-shape functions. We conducted experiments using various real-world datasets to examine the effectiveness of HONAM. Furthermore, we demonstrate that HONAM can achieve fair AI with a slight performance sacrifice. The source code for HONAM is publicly available.

SAS Nonlinear Models or Artificial Higher Order Neural Network Nonlinear Models?

Models of Artificial Higher Order Neural Networks

Data Simulations Using Cosine and Sigmoid Higher Order Neural Networks

Models of Artificial Multi-Polynomial Higher Order Neural Networks

A Neural Network Model For General Minimax Problem

Nonlinear semi-parametric modeling method based on GA-ANN

Data Classification Using Ultra-High Frequency SINC and Trigonometric Higher Order Neural Networks

Artificial Higher Order Neural Networks for Economics and Business

Nonlinear Semi-Parametric Modeling Mothed Based on GA-ANN

Financial Data Prediction by Artificial Sine and Cosine Trigonometric Higher Order Neural Networks

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

Control Signal Generator Based on Ultra-High Frequency Polynomial and Trigonometric Higher Order Neural Networks

Non-Convex Projected Nlms Algorithm for Adaptive Nonlinear Prediction

A New Neural Network Model And Its Application

A neural network based model for multi-dimensional nonlinear Hawkes processes

Group Models of Artificial Polynomial and Trigonometric Higher Order Neural Networks

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

Data Pattern Recognition Based on Ultra-High Frequency Sigmoid and Trigonometric Higher Order Neural Networks

A neural network based model for multi-dimensional non-linear Hawkes processes

Time Series Data Analysis by Ultra-High Frequency Trigonometric Higher Order Neural Networks