Abstract:Graph neural networks excel at modeling pairwise interactions, but they cannot flexibly accommodate higher-order interactions and features. Topological deep learning (TDL) has emerged recently as a promising tool for addressing this issue. TDL enables the principled modeling of arbitrary multi-way, hierarchical higher-order interactions by operating on combinatorial topological spaces, such as simplicial or cell complexes, instead of graphs. However, little is known about how to leverage geometric features such as positions and velocities for TDL. This paper introduces E(n)-Equivariant Topological Neural Networks (ETNNs), which are E(n)-equivariant message-passing networks operating on combinatorial complexes, formal objects unifying graphs, hypergraphs, simplicial, path, and cell complexes. ETNNs incorporate geometric node features while respecting rotation, reflection, and translation equivariance. Moreover, ETNNs are natively ready for settings with heterogeneous interactions. We provide a theoretical analysis to show the improved expressiveness of ETNNs over architectures for geometric graphs. We also show how E(n)-equivariant variants of TDL models can be directly derived from our framework. The broad applicability of ETNNs is demonstrated through two tasks of vastly different scales: i) molecular property prediction on the QM9 benchmark and ii) land-use regression for hyper-local estimation of air pollution with multi-resolution irregular geospatial data. The results indicate that ETNNs are an effective tool for learning from diverse types of richly structured data, as they match or surpass SotA equivariant TDL models with a significantly smaller computational burden, thus highlighting the benefits of a principled geometric inductive bias.

Using Multiple Vector Channels Improves E(n)-Equivariant Graph Neural Networks

Multivector Neurons: Better and Faster O(n)-Equivariant Clifford Graph Neural Networks

Equivariant Graph Hierarchy-Based Neural Networks

Equivariant Vector Field Network for Many-Body System Modeling.

A Clifford Algebraic Approach to E(n)-Equivariant High-order Graph Neural Networks

Equivariant, Safe and Sensitive -- Graph Networks for New Physics

Molecule Graph Networks with Many-body Equivariant Interactions

E( n ) Equivariant Graph Neural Network for Learning Interactional Properties of Molecules

Equivariant Graph Neural Networks for Charged Particle Tracking

E($3$) Equivariant Graph Neural Networks for Particle-Based Fluid Mechanics

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

SE(3) Equivariant Graph Neural Networks with Complete Local Frames

Graph Neural Networks for Learning Equivariant Representations of Neural Networks

Equivariant Matrix Function Neural Networks

Scale equivariance in CNNs with vector fields

E(3)-Equivariant Mesh Neural Networks

Equivariance Is Not All You Need: Characterizing the Utility of Equivariant Graph Neural Networks for Particle Physics Tasks

E(n) Equivariant Topological Neural Networks

E(n) Equivariant Message Passing Cellular Networks

Relaxing Continuous Constraints of Equivariant Graph Neural Networks for Broad Physical Dynamics Learning

Learning Lagrangian Fluid Mechanics with E($3$)-Equivariant Graph Neural Networks