Loss-aware Curriculum Learning for Heterogeneous Graph Neural Networks

Zhen Hao Wong,Hansi Yang,Xiaoyi Fu,Quanming Yao
2024-01-01
Abstract:Heterogeneous Graph Neural Networks (HGNNs) are a class of deep learningmodels designed specifically for heterogeneous graphs, which are graphs thatcontain different types of nodes and edges. This paper investigates theapplication of curriculum learning techniques to improve the performance androbustness of Heterogeneous Graph Neural Networks (GNNs). To better classifythe quality of the data, we design a loss-aware training schedule, named LTSthat measures the quality of every nodes of the data and incorporate thetraining dataset into the model in a progressive manner that increasesdifficulty step by step. LTS can be seamlessly integrated into variousframeworks, effectively reducing bias and variance, mitigating the impact ofnoisy data, and enhancing overall accuracy. Our findings demonstrate theefficacy of curriculum learning in enhancing HGNNs capabilities for analyzingcomplex graph-structured data. The code is public at https://github.com/LARS-research/CLGNN/.
What problem does this paper attempt to address?