Abstract:Dependency trees reflect rich structural information, which can effectively guide models to understand text semantics and are widely used for relation extraction. However, existing dependency-based models suffer from noise in dependency trees, which distorts the modeling of contextual information, particularly when introducing dependency types, further exacerbating the propagation and accumulation of errors. In addition, rule-based pruning strategies used to eliminate noise in dependency trees may lose crucial information for capturing relational patterns, whereas unconstrained learning-based pruning strategies may introduce more noisy edges. These two aspects of dependency trees may cause models to produce semantic confusion, which is detrimental to relation extraction. In this study, we propose a Contextual Dependency-Aware Graph Convolutional Network (C-DAGCN) that works on complete dependency trees and perceives the importance of word dependencies from multiple angles without considering the noise in dependency trees. This study includes three parts. First, the sequence model captures semantic information for the input sentence and its words. We considered the appropriate outputs as word and sentence-level representations based on model characteristics. Second, the structure model enhances the description of the sentence structure and its guidance. We consider that position knowledge implies associations between words; therefore, we propose the Current Word Global Relative Position Knowledge (CW-GRPK) to globally enhance text structure modeling and reduce the models' overreliance on single noisy structure guidance. A dependency-aware module weighs heuristic syntactic knowledge and non-heuristic CW-GRPK to capture fine-grained word-level interactions that effectively distinguish words related to relational semantics. Subsequently, a dependency-guided module, based on the results of the dependency-aware layer, encodes a knowledge-enhanced word graph without losing global linguistic patterns. Third, we constructed high-level linguistic representations based on the results of the sequence and structure model in C-DAGCN as a relational representation and mapped it to the relational decision space for relational prediction. The experimental results demonstrate that our method outperforms nine strong baseline models on two benchmark datasets. Compared with the best baseline Attentive Graph Convolutional Networks (A-GCN) model (Tian et al., 2021), our proposed C-DAGCN model with 90.15 macro-average F1 and 79.52 micro-average F1 achieves 0.28 macro-average F1 and 0.47 micro-average F1 improvement on the SemEval2010-Task8 and ACE2005 datasets, respectively. 1

Structurally Comparative Hinge Loss for Dependency-Based Neural Text Representation

OssCSE: Overcoming Surface Structure Bias in Contrastive Learning for Unsupervised Sentence Embedding

Dependency-Gated Cascade Biaffine Network for Chinese Semantic Dependency Graph Parsing

StructComp: Substituting propagation with Structural Compression in Training Graph Contrastive Learning

Structure-Aware Group Discrimination with Adaptive-View Graph Encoder: A Fast Graph Contrastive Learning Framework

Graph convolutional network with interactive memory fusion for aspect-based sentiment analysis

Structural Supervision for Word Alignment and Machine Translation.

FSS-GCN: A graph convolutional networks with fusion of semantic and structure for emotion cause analysis

Cross-Model Comparative Loss for Enhancing Neuronal Utility in Language Understanding

Modeling Structured Dependency Tree with Graph Convolutional Networks for Aspect-Level Sentiment Classification

DepGraph: Towards Any Structural Pruning

A Contextual Dependency-Aware Graph Convolutional Network for extracting entity relations

Enhancing Structure Preservation in Coreference Resolution by Constrained Graph Encoding

Dependency-based syntax-aware word representations

Learn from Structural Scope: Improving Aspect-Level Sentiment Analysis with Hybrid Graph Convolutional Networks

Semantic Similarity Analysis via Syntax Dependency Structure and Gate Recurrent Unit

Structure Learning for Headline Generation

DualGCN: Exploring Syntactic and Semantic Information for Aspect-Based Sentiment Analysis

Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NER