Abstract:Sentence semantic matching requires an agent to determine the semantic relation between two sentences, which is widely used in various natural language tasks, such as Natural Language Inference (NLI), Paraphrase Identification (PI), and so on. Much recent progress has been made in this area, especially attention-based methods and pre-trained language model based methods. However, most of these methods focus on all the important parts in sentences in a static way and only emphasize how important the words are to the query, inhibiting the ability of attention mechanism. In order to overcome this problem and boost the performance of attention mechanism, we propose a novel dynamic re-read attention, which can pay close attention to one small region of sentences at each step and re-read the important parts for better sentence representations. Based on this attention variation, we develop a novel Dynamic Re-read Network (DRr-Net) for sentence semantic matching. Moreover, selecting one small region in dynamic re-read attention seems insufficient for sentence semantics, and employing pre-trained language models as input encoders will introduce incomplete and fragile representation problems. To this end, we extend DRrNet to Locally-Aware Dynamic Re-read Attention Net (LadRa-Net), in which local structure of sentences is employed to alleviate the shortcoming of Byte-Pair Encoding (BPE) in pre-trained language models and boost the performance of dynamic reread attention. Extensive experiments on two popular sentence semantic matching tasks demonstrate that DRr-Net can significantly improve the performance of sentence semantic matching. Meanwhile, LadRa-Net is able to achieve better performance by considering the local structures of sentences. In addition, it is exceedingly interesting that some discoveries in our experiments are consistent with some findings of psychological research.

RDLNet: A Novel and Accurate Real-world Document Localization Method

LDRNet: Enabling Real-time Document Localization on Mobile Devices

Communication Constrained Cloud-Based Long-Term Visual Localization in Real Time.

LocNet: Global Localization in 3D Point Clouds for Mobile Vehicles

Data Efficient Training of a U-Net Based Architecture for Structured Documents Localization

FDLR-Net: A feature decoupling and localization refinement network for object detection in remote sensing images

DL-RNN: an Accurate Indoor Localization Method Via Double RNNs

R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network

LWR-Net: Robust and Lightweight Place Recognition Network for Noisy and Low-Density Point Clouds

ALNet: An adaptive channel attention network with local discrepancy perception for accurate indoor visual localization

Drone Referring Localization: An Efficient Heterogeneous Spatial Feature Interaction Method For UAV Self-Localization

LadRa-Net: Locally Aware Dynamic Reread Attention Net for Sentence Semantic Matching

Adaptive Discriminative Regions Learning Network for Remote Sensing Scene Classification

Consistency Guided Knowledge Retrieval and Denoising in LLMs for Zero-shot Document-level Relation Triplet Extraction

DLD-SLAM: RGB-D Visual Simultaneous Localisation and Mapping in Indoor Dynamic Environments Based on Deep Learning

LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching

Extraction of Rural Residential Land from Very-High Resolution UAV Images Using a Novel Semantic Segmentation Framework

RaP-Net: A Region-wise and Point-wise Weighting Network to Extract Robust Features for Indoor Localization

Dual-attention-transformer-based semantic reranking for large-scale image localization

RD-YOLO Target Detection for Night Images

RSLC-Deeplab: A Ground Object Classification Method for High-Resolution Remote Sensing Images