Abstract:Referring Expression Comprehension (REC) is the task of grounding object which is referred by the language expression. Previous one-stage REC methods usually use one single language feature vector to represent the whole query for grounding and no reasoning between different objects is performed despite the rich relation cues of objects contained in the language expression, which depresses their grounding accuracy. Additionally, these methods mostly use the feature pyramid networks for multi-scale visual object feature extraction but ground on different feature layers separately, neglecting the connections between objects with different scales. To address these problems, we propose a novel one-stage REC method, i.e. the Entity Relation Fusion Network (ERFN) to locate referred object by relation guided reasoning on different objects. In ERFN, instead of grounding objects at each layer separately, we propose a Language Guided Multi-Scale Fusion (LGMSF) model to utilize language to guide the fusion of representations of objects with different scales into one feature map.For modeling connections between different objects, we design a Relation Guided Feature Fusion (RGFF) model that extracts entities in the language expression to enhance the referred entity feature in the visual object feature map, and further extracts relations to guide object feature fusion based on the self-attention mechanism. Experimental results show that our method is competitive with the state-of-the-art one-stage and two-stage REC methods, and can also keep inferring in real time.

A Graph-Theoretic Fusion Framework for Unsupervised Entity Resolution

Unsupervised Entity Resolution with Blocking and Graph Algorithms

A Novel Approach for Entity Resolution in Scientific Documents Using Context Graphs

CollaborER: A Self-supervised Entity Resolution Framework Using Multi-features Collaboration

A Confidence-Based Entity Resolution Approach with Incomplete Information

An Importance-and-Semantics-Aware Approach for Entity Resolution Using MLP.

A Related Data Oriented Joint Entity Resolution Approach

A Human-And-Machine Cooperative Framework for Entity Resolution with Quality Guarantees

Entity Alignment with Fusing Relation Representation

CollaborEM: A Self-supervised Entity Matching Framework Using Multi-features Collaboration

Entity Resolution On Multiple Relations

How to Evaluate Entity Resolution Systems: An Entity-Centric Framework with Application to Inventor Name Disambiguation

A Method for Entity Resolution in High Dimensional Data Using Ensemble Classifiers

Entity Disambiguation via Fusion Entity Decoding

Information Networks Based Multi-semantic Data Embedding for Entity Resolution.

Graph-based Aspect Representation Learning for Entity Resolution

C3D&#43;P: A Summarization Method for Interactive Entity Resolution

Entity Relation Fusion for Real-Time One-Stage Referring Expression Comprehension.

Entity Resolution with Hybrid Attention-Based Networks

Performance of representation fusion model for entity and relationship extraction within unstructured text

Enhancing Collective Entity Resolution Utilizing Quasi-Clique Similarity Measure