Soft-HGRNs: soft hierarchical graph recurrent networks for multi-agent partially observable environments (vol 24, pg 117, 2023)

Yixiang Ren,Zhenhui Ye,Yining Chen,Xiaohong Jiang,Guanghua Song

DOI: https://doi.org/10.1631/FITEE.22e0073

IF: 2.526

2023-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Unfortunately the funding information was incorrect. It should be the National Key R&D Program of China (No. 2018AAA0102302).

What problem does this paper attempt to address?

Erratum To: Soft-HGRNs: Soft Hierarchical Graph Recurrent Networks for Multi-Agent Partially Observable Environments

Yixiang Ren,Zhenhui Ye,Yining Chen,Xiaohong Jiang,Guanghua Song

DOI: https://doi.org/10.1631/fitee.22e0073

IF: 2.526

2023-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Unfortunately the funding information was incorrect. It should be the National Key R D Program of China (No. 2018AAA0102302).
Soft-HGRNs: Soft Hierarchical Graph Recurrent Networks for Multi-Agent Partially Observable Environments

Yixiang Ren,Zhenhui Ye,Yining Chen,Xiaohong Jiang,Guanghua Song

DOI: https://doi.org/10.1631/fitee.2200073

IF: 2.526

2023-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:The recent progress in multi-agent deep reinforcement learning (MADRL) makes it more practical in real-world tasks, but its relatively poor scalability and the partially observable constraint raise more challenges for its performance and deployment. Based on our intuitive observation that human society could be regarded as a large-scale partially observable environment, where everyone has the functions of communicating with neighbors and remembering his/her own experience, we propose a novel network structure called the hierarchical graph recurrent network (HGRN) for multi-agent cooperation under partial observability. Specifically, we construct the multi-agent system as a graph, use a novel graph convolution structure to achieve communication between heterogeneous neighboring agents, and adopt a recurrent unit to enable agents to record historical information. To encourage exploration and improve robustness, we design a maximum-entropy learning method that can learn stochastic policies of a configurable target action entropy. Based on the above technologies, we propose a value-based MADRL algorithm called Soft-HGRN and its actor-critic variant called SAC-HGRN. Experimental results based on three homogeneous tasks and one heterogeneous environment not only show that our approach achieves clear improvements compared with four MADRL baselines, but also demonstrate the interpretability, scalability, and transferability of the proposed model.
Learning Intra-group Cooperation in Multi-agent Systems.

Weiwei Liu,Shanqi Liu,Jian Yang,Yong Liu

DOI: https://doi.org/10.1109/m2vip49856.2021.9665049

2021-01-01

Abstract:Reinforcement learning is one of the algorithms used in multi-agent systems to promote agent cooperation. However, most current multi-agent reinforcement learning algorithms improve the communication capabilities of agents for cooperation, but the overall communication is costly and even harmful due to bandwidth limitations. In addition, de-centralized execution cannot generate joint actions, which is not conducive to cooperation. Therefore, we proposed the Hierarchical Group Cooperation Network (HGCN). Advanced strategy, Group Network (GroNet), learns to group all agents based on their state rather than their location. The Low-level strategy, Group Cooperation Network (GCoNet), is a method of centralized training and centralized execution within a group, which effectively promotes agent collaboration. Finally, we validated our method in various experiments.
Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Jinjing Yi,Le Yao,Zhiqiang Ge,Zhihuan Song

DOI: https://doi.org/10.1109/ddcls.2019.8908854

2019-01-01

Abstract:Soft sensor provides accurate online estimation of primary variables based on historical data of secondary variables. Recurrent neural network exhibits better performance on sequence data. Deep forest shows quite robust performance across nonlinear data from different domains. In this paper, a multi-grain cascade recurrent neural network(gcRNN) is put forward to soft sensor modeling for nonlinear time-varying processes. Based on deep forest framework, LSTM and GRU are chosen as individual learners in multi-grain moving window scanning and cascade structure to deal with sequence data. Performance of the proposed method is tested and verified on two industrial cases with different process characteristics. Compared to the PLS, RF, LSTM and GRU soft sensing approaches, the root mean squared errors (RMSE) of gcRNN are the smallest. The prediction results also illustrated that gcRNN achieves better performance for primary variable quality prediction in nonlinear time-varying processes.
Scalable and Transferable Reinforcement Learning for Multi-Agent Mixed Cooperative–Competitive Environments Based on Hierarchical Graph Attention

Yining Chen,Guanghua Song,Zhenhui Ye,Xiaohong Jiang

DOI: https://doi.org/10.3390/e24040563

IF: 2.738

2022-04-18

Entropy

Abstract:Most previous studies on multi-agent systems aim to coordinate agents to achieve a common goal, but the lack of scalability and transferability prevents them from being applied to large-scale multi-agent tasks. To deal with these limitations, we propose a deep reinforcement learning (DRL) based multi-agent coordination control method for mixed cooperative–competitive environments. To improve scalability and transferability when applying in large-scale multi-agent systems, we construct inter-agent communication and use hierarchical graph attention networks (HGAT) to process the local observations of agents and received messages from neighbors. We also adopt the gated recurrent units (GRU) to address the partial observability issue by recording historical information. The simulation results based on a cooperative task and a competitive task not only show the superiority of our method, but also indicate the scalability and transferability of our method in various scale tasks.

physics, multidisciplinary
H2GNN: Hierarchical-Hops Graph Neural Networks for Multi-Robot Exploration in Unknown Environments

Hao Zhang,Jiyu Cheng,Lin Zhang,Yibin Li,Wei Zhang

DOI: https://doi.org/10.1109/lra.2022.3146912

IF: 5.2

2022-01-01

IEEE Robotics and Automation Letters

Abstract:Multi-robot coarse-to-fine exploration in unknown environments makes great sense in many application fields like search and rescue. For different stages of the task, robots need to extract information from the environment discriminately, which can improve their decision-making capability. To this end, we present the Hierarchical-Hops Graph Neural Networks (H2GNN) to enable robots to targetedly integrate the key information of the graph-represented environment, which distinguishes the importance of information from different hops around robots based on the multi-head attention mechanism. And in order to improve the efficiency of cooperation, we utilize multi-agent reinforcement learning (MARL) to help robots to learn collaborative strategies implicitly. We conduct experiments to verify our proposed method in a simulation environment, and the experimental results demonstrate that the H2GNN significantly improves the multi-robot exploration performance in unknown environments.
Hierarchical recurrent neural networks for graph generation

Song Xianduo,Wang Xin,Song Yuyuan,Zuo Xianglin,Wang Ying

DOI: https://doi.org/10.1016/j.ins.2021.12.073

IF: 8.1

2022-04-01

Information Sciences

Abstract:Graph generation is widely used in various fields, such as social science, chemistry, and physics. Although the deep graph generative models have achieved considerable success in recent years, some problems still need to be addressed. First, some models learn only the structural information and cannot capture the semantic information. Second, many existing models cannot be applied to large-scale datasets owing to a complex training process and a large number of parameters to be learned. Third, most of the existing models require domain-specific rules to be set up, resulting in poor generalization. To address the aforementioned problems, we propose a domain-agnostic model with hierarchical recurrent neural networks, named GHRNN, which learns the distribution of graph data for generating new graphs. First, we utilize the minimum depth-first-search code to convert a graph into a unique edge sequence that naturally generalizes to various graphs. Then, we adopt the edge-level recurrent neural network (RNN) module to learn the global structure of a graph and the element-level RNN module to obtain semantic information, such as node labels, edge labels, and the timestamp of nodes. The element-level RNN module with a fixed and small number of time steps in GHRNN can efficiently scale to large datasets. Finally, we generate a large number of graphs and evaluate the effectiveness of our model by using 11 different metrics on diverse datasets ranging from molecules to citation networks. Extensive experimental results indicate that GHRNN can capture complex dependencies and generate the most realistic and diverse graphs, in contrast to several state-of-the-art baselines.

computer science, information systems
HRGCN: Heterogeneous Graph-level Anomaly Detection with Hierarchical Relation-augmented Graph Neural Networks

Jiaxi Li,Mohammad-Reza Namazi-Rad,Ling Chen,Guansong Pang

DOI: https://doi.org/10.1109/DSAA60987.2023.10302626

2023-08-28

Abstract:This work considers the problem of heterogeneous graph-level anomaly detection. Heterogeneous graphs are commonly used to represent behaviours between different types of entities in complex industrial systems for capturing as much information about the system operations as possible. Detecting anomalous heterogeneous graphs from a large set of system behaviour graphs is crucial for many real-world applications like online web/mobile service and cloud access control. To address the problem, we propose HRGCN, an unsupervised deep heterogeneous graph neural network, to model complex heterogeneous relations between different entities in the system for effectively identifying these anomalous behaviour graphs. HRGCN trains a hierarchical relation-augmented Heterogeneous Graph Neural Network (HetGNN), which learns better graph representations by modelling the interactions among all the system entities and considering both source-to-destination entity (node) types and their relation (edge) types. Extensive evaluation on two real-world application datasets shows that HRGCN outperforms state-of-the-art competing anomaly detection approaches. We further present a real-world industrial case study to justify the effectiveness of HRGCN in detecting anomalous (e.g., congested) network devices in a mobile communication service. HRGCN is available at https://github.com/jiaxililearn/HRGCN.

Computer Science
Hyper-relationship Learning Network for Scene Graph Generation

Yibing Zhan,Zhi Chen,Jun Yu,BaoSheng Yu,Dacheng Tao,Yong Luo

DOI: https://doi.org/10.48550/arXiv.2202.07271

2022-02-15

Computer Vision and Pattern Recognition

Abstract:Generating informative scene graphs from images requires integrating and reasoning from various graph components, i.e., objects and relationships. However, current scene graph generation (SGG) methods, including the unbiased SGG methods, still struggle to predict informative relationships due to the lack of 1) high-level inference such as transitive inference between relationships and 2) efficient mechanisms that can incorporate all interactions of graph components. To address the issues mentioned above, we devise a hyper-relationship learning network, termed HLN, for SGG. Specifically, the proposed HLN stems from hypergraphs and two graph attention networks (GATs) are designed to infer relationships: 1) the object-relationship GAT or OR-GAT to explore interactions between objects and relationships, and 2) the hyper-relationship GAT or HR-GAT to integrate transitive inference of hyper-relationships, i.e., the sequential relationships between three objects for transitive reasoning. As a result, HLN significantly improves the performance of scene graph generation by integrating and reasoning from object interactions, relationship interactions, and transitive inference of hyper-relationships. We evaluate HLN on the most popular SGG dataset, i.e., the Visual Genome dataset, and the experimental results demonstrate its great superiority over recent state-of-the-art methods. For example, the proposed HLN improves the recall per relationship from 11.3\% to 13.1\%, and maintains the recall per image from 19.8\% to 34.9\%. We will release the source code and pretrained models on GitHub.
Graph MADDPG with RNN for multiagent cooperative environment

Xiaolong Wei,WenPeng Cui,Xianglin Huang,LiFang Yang,Zhulin Tao,Bing Wang

DOI: https://doi.org/10.3389/fnbot.2023.1185169

IF: 3.493

2023-06-29

Frontiers in Neurorobotics

Abstract:Multiagent systems face numerous challenges due to environmental uncertainty, with scalability being a critical issue. To address this, we propose a novel multi-agent cooperative model based on a graph attention network. Our approach considers the relationship between agents and continuous action spaces, utilizing graph convolution and recurrent neural networks to define these relationships. Graph convolution is used to define the relationship between agents, while recurrent neural networks define continuous action spaces. We optimize and model the multiagent system by encoding the interaction weights among agents using the graph neural network and the weights between continuous action spaces using the recurrent neural network. We evaluate the performance of our proposed model by conducting experimental simulations using a 3D wargame engine that involves several unmanned air vehicles (UAVs) acting as attackers and radar stations acting as defenders, where both sides have the ability to detect each other. The results demonstrate that our proposed model outperforms the current state-of-the-art methods in terms of scalability, robustness, and learning efficiency.

robotics,computer science, artificial intelligence,neurosciences
Subgoal-based Hierarchical Reinforcement Learning for Multi-Agent Collaboration

Cheng Xu,Changtian Zhang,Yuchen Shi,Ran Wang,Shihong Duan,Yadong Wan,Xiaotong Zhang

2024-08-21

Abstract:Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the challenges of exploration and dimensionality explosion. Hierarchical reinforcement learning (HRL) offers a structured approach to decompose complex tasks into simpler sub-tasks, which is promising for multi-agent settings. This paper advances the field by introducing a hierarchical architecture that autonomously generates effective subgoals without explicit constraints, enhancing both flexibility and stability in training. We propose a dynamic goal generation strategy that adapts based on environmental changes. This method significantly improves the adaptability and sample efficiency of the learning process. Furthermore, we address the critical issue of credit assignment in multi-agent systems by synergizing our hierarchical architecture with a modified QMIX network, thus improving overall strategy coordination and efficiency. Comparative experiments with mainstream reinforcement learning algorithms demonstrate the superior convergence speed and performance of our approach in both single-agent and multi-agent environments, confirming its effectiveness and flexibility in complex scenarios. Our code is open-sourced at: \url{<a class="link-external link-https" href="https://github.com/SICC-Group/GMAH" rel="external noopener nofollow">this https URL</a>}.

Multiagent Systems,Robotics
Cascaded Attention: Adaptive and Gated Graph Attention Network for Multiagent Reinforcement Learning

Shuhan Qi,Xinhao Huang,Peixi Peng,Xuzhong Huang,Jiajia Zhang,Xuan Wang

DOI: https://doi.org/10.1109/tnnls.2022.3197918

IF: 14.255

2022-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Modeling the interactive relationships of agents is critical to improving the collaborative capability of a multiagent system. Some methods model these by predefined rules. However, due to the nonstationary problem, the interactive relationship changes over time and cannot be well captured by rules. Other methods adopt a simple mechanism such as an attention network to select the neighbors the current agent should collaborate with. However, in large-scale multiagent systems, collaborative relationships are too complicated to be described by a simple attention network. We propose an adaptive and gated graph attention network (AGGAT), which models the interactive relationships between agents in a cascaded manner. In the AGGAT, we first propose a graph-based hard attention network that roughly filters irrelevant agents. Then, normal soft attention is adopted to decide the importance of each neighbor. Finally, gated attention further refines the collaborative relationship of agents. By using cascaded attention, the collaborative relationship of agents is precisely learned in a coarse-to-fine style. Extensive experiments are conducted on a variety of cooperative tasks. The results indicate that our proposed method outperforms state-of-the-art baselines.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Foresight of Graph Reinforcement Learning Latent Permutations Learnt by Gumbel Sinkhorn Network

Tianqi Shen,Hong Zhang,Ding Yuan,Jiaping Xiao,Yifan Yang

2021-01-01

Abstract: Vital importance has necessity to be attached to cooperation in multi-agent environments, as a result of which some reinforcement learning algorithms combined with graph neural networks have been proposed to understand the mutual interplay between agents. However, highly complicated and dynamic multi-agent environments require more ingenious graph neural networks, which can comprehensively represent not only the graph topology structure but also evolution process of the structure due to agents emerging, disappearing and moving. To tackle these difficulties, we propose Gumbel Sinkhorn graph attention reinforcement learning, where a graph attention network highly represents the underlying graph topology structure of the multi-agent environment, and can adapt to the dynamic topology structure of graph better with the help of Gumbel Sinkhorn network by learning latent permutations. Empirically, simulation results show how our proposed graph reinforcement learning methodology outperforms existing methods in the PettingZoo multi-agent environment by learning latent permutations.
HGRN2: Gated Linear RNNs with State Expansion

Zhen Qin,Songlin Yang,Weixuan Sun,Xuyang Shen,Dong Li,Weigao Sun,Yiran Zhong

2024-08-20

Abstract:Hierarchically gated linear RNN (HGRN, \citealt{HGRN}) has demonstrated competitive training speed and performance in language modeling while offering efficient inference. However, the recurrent state size of HGRN remains relatively small, limiting its expressiveness. To address this issue, we introduce a simple outer product-based state expansion mechanism, which significantly enlarges the recurrent state size without introducing any additional parameters. This enhancement also provides a linear attention interpretation for HGRN2, enabling hardware-efficient training. Our extensive experiments verify the advantage of HGRN2 over HGRN consistently across different settings and competitive with other recurrent models.

Computation and Language
Temporal and Heterogeneous Graph Neural Network for Financial Time Series Prediction

Sheng Xiang,Dawei Cheng,Chencheng Shang,Ying Zhang,Yuqi Liang

DOI: https://doi.org/10.1145/3511808.3557089

2023-05-09

Abstract:The price movement prediction of stock market has been a classical yet challenging problem, with the attention of both economists and computer scientists. In recent years, graph neural network has significantly improved the prediction performance by employing deep learning on company relations. However, existing relation graphs are usually constructed by handcraft human labeling or nature language processing, which are suffering from heavy resource requirement and low accuracy. Besides, they cannot effectively response to the dynamic changes in relation graphs. Therefore, in this paper, we propose a temporal and heterogeneous graph neural network-based (THGNN) approach to learn the dynamic relations among price movements in financial time series. In particular, we first generate the company relation graph for each trading day according to their historic price. Then we leverage a transformer encoder to encode the price movement information into temporal representations. Afterward, we propose a heterogeneous graph attention network to jointly optimize the embeddings of the financial time series data by transformer encoder and infer the probability of target movements. Finally, we conduct extensive experiments on the stock market in the United States and China. The results demonstrate the effectiveness and superior performance of our proposed methods compared with state-of-the-art baselines. Moreover, we also deploy the proposed THGNN in a real-world quantitative algorithm trading system, the accumulated portfolio return obtained by our method significantly outperforms other baselines.

Statistical Finance,Machine Learning,Portfolio Management
OpenHGNN: an Open Source Toolkit for Heterogeneous Graph Neural Network

Hui Han,Tianyu Zhao,Cheng Yang,Hongyi Zhang,Yaoqi Liu,Xiao Wang,Chuan Shi

DOI: https://doi.org/10.1145/3511808.3557664

2022-01-01

Abstract:Heterogeneous Graph Neural Networks (HGNNs), as a kind of powerful graph representation learning methods on heterogeneous graphs, have attracted increasing attention of many researchers. Although, several existing libraries have supported HGNNs, they just provide the most basic models and operators. Building and bench-marking various downstream tasks on HGNNs is still painful and time consuming with them. In this paper, we will introduce Open-HGNN, an open-source toolkit for HGNNs. OpenHGNN defines a unified and standard pipeline for training and testing, which can allow users to run a model on a specific dataset with just one command line. OpenHGNN has integrated 20+ mainstream HGNNs and 20+ heterogeneous graph datasets, which can be used for various advanced tasks, such as node classification, link prediction, and recommendation. In addition, thanks to the modularized design of OpenHGNN, it can be extended to meet users' customized needs. We also release several novel and useful tools and features, including leaderboard, autoML, design space, and visualization, to provide users with better usage experiences. Open-HGNN is an open-source project, and the source code is available at https://github.com/BUPT- GAMMA/OpenHGNN.
Global Context Enhanced Social Recommendation with Hierarchical Graph Neural Networks

Huance Xu,Chao Huang,Yong Xu,Lianghao Xia,Hao Xing,Dawei Yin

DOI: https://doi.org/10.48550/arXiv.2110.04039

2021-10-08

Abstract:Social recommendation which aims to leverage social connections among users to enhance the recommendation performance. With the revival of deep learning techniques, many efforts have been devoted to developing various neural network-based social recommender systems, such as attention mechanisms and graph-based message passing frameworks. However, two important challenges have not been well addressed yet: (i) Most of existing social recommendation models fail to fully explore the multi-type user-item interactive behavior as well as the underlying cross-relational inter-dependencies. (ii) While the learned social state vector is able to model pair-wise user dependencies, it still has limited representation capacity in capturing the global social context across users. To tackle these limitations, we propose a new Social Recommendation framework with Hierarchical Graph Neural Networks (SR-HGNN). In particular, we first design a relation-aware reconstructed graph neural network to inject the cross-type collaborative semantics into the recommendation framework. In addition, we further augment SR-HGNN with a social relation encoder based on the mutual information learning paradigm between low-level user embeddings and high-level global representation, which endows SR-HGNN with the capability of capturing the global social contextual signals. Empirical results on three public benchmarks demonstrate that SR-HGNN significantly outperforms state-of-the-art recommendation methods. Source codes are available at: <a class="link-external link-https" href="https://github.com/xhcdream/SR-HGNN" rel="external noopener nofollow">this https URL</a>.

Information Retrieval,Artificial Intelligence,Machine Learning
Soft-mask: Adaptive Substructure Extractions for Graph Neural Networks

Mingqi Yang,Yanming Shen,Heng Qi,Baocai Yin

DOI: https://doi.org/10.1145/3442381.3449929

2021-01-01

Abstract:ABSTRACT For learning graph representations, not all detailed structures within a graph are relevant to the given graph tasks. Task-relevant structures can be localized or sparse which are only involved in subgraphs or characterized by the interactions of subgraphs (a hierarchical perspective). A graph neural network should be able to efficiently extract task-relevant structures and be invariant to irrelevant parts, which is challenging for general message passing GNNs. In this work, we propose to learn graph representations from a sequence of subgraphs of the original graph to better capture task-relevant substructures or hierarchical structures and skip noisy parts. To this end, we design soft-mask GNN layer to extract desired subgraphs through the mask mechanism. The soft-mask is defined in a continuous space to maintain the differentiability and characterize the weights of different parts. Compared with existing subgraph or hierarchical representation learning methods and graph pooling operations, the soft-mask GNN layer is not limited by the fixed sample or drop ratio, and therefore is more flexible to extract subgraphs with arbitrary sizes. Extensive experiments on public graph benchmarks show that soft-mask mechanism brings performance improvements. And it also provides interpretability where visualizing the values of masks in each layer allows us to have an insight into the structures learned by the model.
HGAMLP: Heterogeneous Graph Attention MLP with De-Redundancy Mechanism

Yuxuan Liang,Wentao Zhang,Zeang Sheng,Ling Yang,Jiawei Jiang,Yunhai Tong,Bin Cui

DOI: https://doi.org/10.1109/icde60146.2024.00217

2024-01-01

Abstract:Heterogeneous graphs contain rich semantic information that can be exploited by heterogeneous graph neural networks (HGNNs). However, scaling HGNNs to large graphs is challenging due to the high computational cost. Existing non-parametric HGNNs use general subgraphs construction method and mean aggregator before training to reduce the complexity. Despite their success, they ignore two key characteristics of heterogeneous graphs, leading to low predictive performance. First, they adopt fixed local and global knowledge extractor for the feature aggregation and the semantic fusion. Besides, they bury the graph structure information of the higher-order meta-paths and fail to explore deeper graph structure information. In this paper, we address these two limitations and propose a new non-parametric HGNN framework called Heterogeneous Graph Attention Multi-Layer Perceptron (HGAMLP). Our framework employs the local multi-knowledge extractor to enhance the node representation, and leverages the de-redundancy mechanism to extract the pure graph structure information from higher-order meta-paths. Besides, it adopts a node-adaptive weight adjustment mechanism as an efficiency training model to fuse global knowledge and local knowledge. We evaluate our framework on ten commonly used heterogeneous graph datasets and show that it outperforms the state-of-the-art baselines in both accuracy and speed. Notably, our framework achieves the best performance on the large public heterogeneous graph dataset (i.e., Ogbn-mag) of Open Graph Benchmark 1 1 https://ogb.stanford.edu/docs/leader_nodeprop.
ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network

Xingcheng Fu,Jianxin Li,Jia Wu,Qingyun Sun,Cheng Ji,Senzhang Wang,Jiajun Tan,Hao Peng,Philip S. Yu

DOI: https://doi.org/10.1109/icdm51629.2021.00021

2021-12-01

Abstract:Graph Neural Networks (GNNs) have been widely studied in various graph data mining tasks. Most existing GNNs embed graph data into Euclidean space and thus are less effective to capture the ubiquitous hierarchical structures in real-world networks. Hyperbolic Graph Neural Networks (HGNNs) extend GNNs to hyperbolic space and thus are more effective to capture the hierarchical structures of graphs in node representation learning. In hyperbolic geometry, the graph hierarchical structure can be reflected by the curvatures of the hyperbolic space, and different curvatures can model different hierarchical structures of a graph. However, most existing HGNNs manually set the curvature to a fixed value for simplicity, which achieves a suboptimal performance of graph learning due to the complex and diverse hierarchical structures of the graphs. To resolve this problem, we propose an Adaptive Curvature Exploration Hyperbolic Graph Neural Network named ACE-HGNN to adaptively learn the optimal curvature according to the input graph and downstream tasks. Specifically, ACE-HGNN exploits a multi-agent reinforcement learning framework and contains two agents, ACE-Agent and HGNN-Agent for learning the curvature and node representations, respectively. The two agents are updated by a Nash Q-leaning algorithm collaboratively, seeking the optimal hyperbolic space indexed by the curvature. Extensive experiments on multiple real-world graph datasets demonstrate a significant and consistent performance improvement in model quality with competitive performance and good generalization ability.

Soft-HGRNs: soft hierarchical graph recurrent networks for multi-agent partially observable environments (vol 24, pg 117, 2023)

Erratum To: Soft-HGRNs: Soft Hierarchical Graph Recurrent Networks for Multi-Agent Partially Observable Environments

Soft-HGRNs: Soft Hierarchical Graph Recurrent Networks for Multi-Agent Partially Observable Environments

Learning Intra-group Cooperation in Multi-agent Systems.

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Scalable and Transferable Reinforcement Learning for Multi-Agent Mixed Cooperative–Competitive Environments Based on Hierarchical Graph Attention

H2GNN: Hierarchical-Hops Graph Neural Networks for Multi-Robot Exploration in Unknown Environments

Hierarchical recurrent neural networks for graph generation

HRGCN: Heterogeneous Graph-level Anomaly Detection with Hierarchical Relation-augmented Graph Neural Networks

Hyper-relationship Learning Network for Scene Graph Generation

Graph MADDPG with RNN for multiagent cooperative environment

Subgoal-based Hierarchical Reinforcement Learning for Multi-Agent Collaboration

Cascaded Attention: Adaptive and Gated Graph Attention Network for Multiagent Reinforcement Learning

Foresight of Graph Reinforcement Learning Latent Permutations Learnt by Gumbel Sinkhorn Network

HGRN2: Gated Linear RNNs with State Expansion

Temporal and Heterogeneous Graph Neural Network for Financial Time Series Prediction

OpenHGNN: an Open Source Toolkit for Heterogeneous Graph Neural Network

Global Context Enhanced Social Recommendation with Hierarchical Graph Neural Networks

Soft-mask: Adaptive Substructure Extractions for Graph Neural Networks

HGAMLP: Heterogeneous Graph Attention MLP with De-Redundancy Mechanism

ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network