Abstract:Black-box models, such as deep neural networks, exhibit superior predictive performances, but understanding their behavior is notoriously difficult. Many explainable artificial intelligence methods have been proposed to reveal the decision-making processes of black box models. However, their applications in high-stakes domains remain limited. Recently proposed neural additive models (NAM) have achieved state-of-the-art interpretable machine learning. NAM can provide straightforward interpretations with slight performance sacrifices compared with multi-layer perceptron. However, NAM can only model 1$^{\text{st}}$-order feature interactions; thus, it cannot capture the co-relationships between input features. To overcome this problem, we propose a novel interpretable machine learning method called higher-order neural additive models (HONAM) and a feature interaction method for high interpretability. HONAM can model arbitrary orders of feature interactions. Therefore, it can provide the high predictive performance and interpretability that high-stakes domains need. In addition, we propose a novel hidden unit to effectively learn sharp-shape functions. We conducted experiments using various real-world datasets to examine the effectiveness of HONAM. Furthermore, we demonstrate that HONAM can achieve fair AI with a slight performance sacrifice. The source code for HONAM is publicly available.

Models of Artificial Higher Order Neural Networks

Data Simulations Using Cosine and Sigmoid Higher Order Neural Networks

SAS Nonlinear Models or Artificial Higher Order Neural Network Nonlinear Models?

Models of Artificial Multi-Polynomial Higher Order Neural Networks

Data Classification Using Ultra-High Frequency SINC and Trigonometric Higher Order Neural Networks

Data Pattern Recognition Based on Ultra-High Frequency Sigmoid and Trigonometric Higher Order Neural Networks

Control Signal Generator Based on Ultra-High Frequency Polynomial and Trigonometric Higher Order Neural Networks

Artificial Higher Order Neural Networks for Computer Science and Engineering: Trends for Emerging Applications

Artificial Higher Order Neural Networks for Economics and Business

Utilizing Feature Selection on Higher Order Neural Networks

Financial Data Prediction by Artificial Sine and Cosine Trigonometric Higher Order Neural Networks

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

A Theoretical Framework for Parallel Implementation of Deep Higher Order Neural Networks

HONNs with ELM Algorithm for Medical Applications.

Group Models of Artificial Polynomial and Trigonometric Higher Order Neural Networks

Face Recognition Based on Higher Order Neural Network Group-Based Adaptive Tolerance Trees

Complete Stability Control on the High-Order Neural Networks

Demystifying Higher-Order Graph Neural Networks

Dynamical analysis on the multistability of high-order neural networks

Dynamics in Artificial Higher Order Neural Networks with Delays

A Survey on Hypergraph Neural Networks: An In-Depth and Step-By-Step Guide