Abstract:Quantifying the importance of nodes is a fundamental and significant problem in network science. Potential applications including identifying critical people, epidemic spreading control, rumor control, protecting critical infrastructures that is vulnerable, predicting key proteins, and so on. However, most of the existing methods concentrate on the iterative approaches, only a minority of methods attempt to explore the importance of nodes by adopting machine learning. More importantly, in reality, multiple nodes often work together or generate associations. Although the existing important nodes mining methods based on machine learning consider network structures and node features, all of them ignore the higher-order relationships, i.e., multiple nodes interactions. Inspired by this, to accurately identify critical nodes with higher-order interaction information in networks, we propose a novel higher-order neural network framework based on motif-attention (i.e., HONNMA) from the perspective of higher-order interactions. The proposed framework (i.e., HONNMA) can encode the higher-order interaction relationships by employing weighted motif adjacency matrix, and learn the attention weights by motif-based attention mechanism, then adopt skip connection to obtain the node embeddings, finally use multiple feedforward layers to predict the critical scores of nodes. Extensive experiments conducted on four real-world datasets demonstrate the proposed model significantly outperforms the existing state-of-the-art baseline methods. To emphasize that, the higher-order neural network framework (i.e., HONNMA) can enhance the prediction of important nodes such as critical infrastructures, critical people, critical scientific publications, and critical proteins, and much more.

Utilizing Feature Selection on Higher Order Neural Networks

Models of Artificial Higher Order Neural Networks

Unsupervised Hierarchical Feature Selection on Networked Data.

A Novel Higher-Order Neural Network Framework Based on Motifs Attention for Identifying Critical Nodes

Higher order heterogeneous graph neural network based on node attribute enhancement

HCFNN: High-order Coverage Function Neural Network for Image Classification

HONNs with ELM Algorithm for Medical Applications.

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

Face Recognition Based on Higher Order Neural Network Group-Based Adaptive Tolerance Trees

Human-in-the-Loop Feature Selection Using Interpretable Kolmogorov-Arnold Network-based Double Deep Q-Network

Nonlinear Feature Selection on Attributed Networks

Unsupervised feature selection with high-order similarity learning

Artificial Higher Order Neural Networks for Computer Science and Engineering: Trends for Emerging Applications

Convolution Neural Network Feature Importance Analysis and Feature Selection Enhanced Model

Semi-Supervised Nonlinear Feature Selection on Attributed Networks

Artificial Higher Order Neural Networks For Modeling Combinatorial Optimization Problems

Consistent Feature Selection for Analytic Deep Neural Networks

Efficient feature selection using one-pass generalized classifier neural network and binary bat algorithm with a novel fitness function

Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions.

FsNet: Feature Selection Network on High-dimensional Biological Data

Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks