Abstract:Deep semantic matching aims at discriminating the relationship between documents based on deep neural networks. In recent years, it becomes increasingly popular to organize documents with a graph structure, then leverage both the intrinsic document features and the extrinsic neighbor features to derive discrimination. Most of the existing works mainly care about how to utilize the presented neighbors, whereas limited effort is made to filter appropriate neighbors. We argue that the neighbor features could be highly noisy and partially useful. Thus, a lack of effective neighbor selection will not only incur a great deal of unnecessary computation cost but also restrict the matching accuracy severely. In this work, we propose a novel framework, C ascaded D eep S emantic M atching ( CDSM ), for accurate and efficient semantic matching on textual graphs. CDSM is highlighted for its two-stage workflow. In the first stage, a lightweight CNN-based ad-hod neighbor selector is deployed to filter useful neighbors for the matching task with a small computation cost. We design both one-step and multi-step selection methods. In the second stage, a high-capacity graph-based matching network is employed to compute fine-grained relevance scores based on the well-selected neighbors. It is worth noting that CDSM is a generic framework which accommodates most of the mainstream graph-based semantic matching networks. The major challenge is how the selector can learn to discriminate the neighbors’ usefulness which has no explicit labels. To cope with this problem, we design a weak-supervision strategy for optimization, where we train the graph-based matching network at first and then the ad-hoc neighbor selector is learned on top of the annotations from the matching network. We conduct extensive experiments with three large-scale datasets, showing that CDSM notably improves the semantic matching accuracy and efficiency thanks to the selection of high-quality neighbors. The source code is released at https://github.com/jingjyyao/CDSM.

Enhanced Text Matching Based on Semantic Transformation

Enhanced Text Matching Based on Semantic Transformation

Select & Re-Rank: Effectively and Efficiently Matching Multimodal Data with Dynamically Evolving Attention

Improving Text Matching with Semantic Dependency Graph via Message Passing Neural Network

Densely-Connected Transformer with Co-attentive Information for Matching Text Sequences.

Short Text Semantic Matching Model Based on Bert and Adversarial Network.

Comateformer: Combined Attention Transformer for Semantic Sentence Matching

Enhanced Pre-Trained Transformer with Aligned Attention Map for Text Matching

Text Matching As Image Recognition

Lightweight Text Matching Method with Rich Features.

A Survey on Deep Text Matching

Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models

Enhanced Semantic Similarity Learning Framework for Image-Text Matching

Analysis of the text matching problem

Multi-level network based on transformer encoder for fine-grained image–text matching

Advanced Multimodal Deep Learning Architecture for Image-Text Matching

Hierarchical Feature Aggregation based on Transformer for Image-text Matching

Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding

HyperMatch: long-form text matching via hypergraph convolutional networks

Adversarial Feature Matching for Text Generation

CDSM: C ascaded D eep S emantic M atching on Textual Graphs Leveraging Ad-hoc Neighbor Selection