Cross-GCN: Enhancing Graph Convolutional Network with K-Order Feature Interactions

Fuli Feng,Xiangnan He,Hanwang Zhang,Tat-Seng Chua
DOI: https://doi.org/10.1109/tkde.2021.3077524
IF: 9.235
2021-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:Graph Convolutional Network (GCN) is an emerging technique that performslearning and reasoning on graph data. It operates feature learning on the graphstructure, through aggregating the features of the neighbor nodes to obtain theembedding of each target node. Owing to the strong representation power, recentresearch shows that GCN achieves state-of-the-art performance on several taskssuch as recommendation and linked document classification. Despite its effectiveness, we argue that existing designs of GCN forgomodeling cross features, making GCN less effective for tasks or data wherecross features are important. Although neural network can approximate anycontinuous function, including the multiplication operator for modeling featurecrosses, it can be rather inefficient to do so (i.e., wasting many parametersat the risk of overfitting) if there is no explicit design. To this end, we design a new operator named Cross-feature Graph Convolution,which explicitly models the arbitrary-order cross features with complexitylinear to feature dimension and order size. We term our proposed architectureas Cross-GCN, and conduct experiments on three graphs to validate itseffectiveness. Extensive analysis validates the utility of explicitly modelingcross features in GCN, especially for feature learning at lower layers.
What problem does this paper attempt to address?