GCN-CA: Co-Attention for Text Matching by Text Graph Representation

Gang Liu,Zhizheng Yan,Yichao Dong,Tongli Wang,Kai Zhan
DOI: https://doi.org/10.21203/rs.3.rs-2536776/v1
2023-01-01
Abstract:Abstract For text matching task, most works usually own to lack sequence information, neglect some text information, consequently, and thus fail to extract deeper interaction information by merely using insufficient information extraction methods. Graph representation learning is an effective method, which maps nodes into vectors to retain as much topological information as possible. We propose a feature extraction and text matching method based on graph convolutional network and co-attention mechanism called GCN-CA. It is designed to realize text interaction and matching feature extraction by constructing a text graph, which integrates syntactic information and sequence information into the graph by dividing text matching task into two phrases: extracting features and matching. This paper proposed models contains graph convolutional network constructing a text graph which has syntactic and sequence information, and a multi-layer co-attention network realizing text interaction and matching feature extraction. Experiments show that the proposed approach achieves competitive performances on the Quora, Ant Financial datasets. We achieve accuracy 0.9073 and F1 0.9052 on Quoradatasets, and accuracy 0.7780 and F1 0.7493 on Ant Financial datasets.
What problem does this paper attempt to address?