ObjectCoref & Falcon-AO: Results for OAEI 2010.

Wei Hu,Jianfeng Chen,Gong Cheng,Yuzhong Qu

2010-01-01

Abstract:In this report, we mainly present an overview of ObjectCoref, which follows a self-training framework to resolve object coreference on the Semantic Web. Besides, we show preliminary results of Falcon-AO (2010) for this year's OAEI campaign, including the benchmark and conference tracks.

What problem does this paper attempt to address?

Falcon-AO: Results for OAEI 2007

Wei Hu,Yuanyuan Zhao,Dan Li,Gong Cheng,Honghan Wu,Yuzhong Qu

2007-01-01

Abstract:In this paper, we present a brief overview of Falcon-AO (version 0.7): a practical ontology matching system with acceptable to very good performance, a flexible architecture, and a number of unique features. We also show some pre- liminary results of Falcon-AO for this year's OAEI campaign: evaluation on seven different matching tasks.
The Results of Falcon-AO in the OAEI 2006 Campaign.

Wei Hu,Gong Cheng,Dongdong Zheng,Xinyu Zhong,Yuzhong Qu

2006-01-01

Abstract:In this paper, we briefly introduce the architecture of Falcon-AO (version 0.6) and highlight two major improvements in the current version. Falcon-AO successfully completes all the five alignment tasks in the OAEI 2006 campaign: benchmark, anatomy, directory, food, and conference, and some preliminary results are also reported in this paper. In the end, we present some comments about our results and lessons learnt from the campaign towards building a comprehensive ontology alignment system.
A Self-Training Approach for Resolving Object Coreference on the Semantic Web

HU Wei,BAI Wen-Yang,QU Yu-Zhong

DOI: https://doi.org/10.1145/1963405.1963421

2012-01-01

Abstract:An object on the Semantic Web is likely to be denoted with multiple URIs by different parties. Object coreference resolution is to identify "equivalent" URIs that denote the same object. Driven by the Linking Open Data (LOD) initiative, millions of URIs have been explicitly linked with owl:sameAs statements, but potentially coreferent ones are still considerable. Existing approaches address the problem mainly from two directions: one is based upon equivalence inference mandated by OWL semantics, which finds semantically coreferent URIs but probably omits many potential ones; the other is via similarity computation between property-value pairs, which is not always accurate enough. In this paper, we propose a self-training approach for object coreference resolution on the Semantic Web, which leverages the two classes of approaches to bridge the gap between semantically coreferent URIs and potential candidates. For an object URI, we firstly establish a kernel that consists of semantically coreferent URIs based on owl:sameAs, (inverse) functional properties and (max-)cardinalities, and then extend such kernel iteratively in terms of discriminative property-value pairs in the descriptions of URIs. In particular, the discriminability is learnt with a statistical measurement, which not only exploits key characteristics for representing an object, but also takes into account the matchability between properties from pragmatics. In addition, frequent property combinations are mined to improve the accuracy of the resolution. We implement a scalable system and demonstrate that our approach achieves good precision and recall for resolving object coreference, on both benchmark and large-scale datasets.
Bootstrapping Object Coreferencing on the Semantic Web

Wei Hu,Yu-Zhong Qu,Xing-Zhi Sun

DOI: https://doi.org/10.1007/s11390-011-1166-z

IF: 1.871

2011-01-01

Journal of Computer Science and Technology

Abstract:An object on the Semantic Web is likely to be denoted with several URIs by different parties. Object coreferencing is a process to identify “equivalent” URIs of objects for achieving a better Data Web. In this paper, we propose a bootstrapping approach for object coreferencing on the Semantic Web. For an object URI, we firstly establish a kernel that consists of semantically equivalent URIs from the same-as, (inverse) functional properties and (max-)cardinalities, and then extend the kernel with respect to the textual descriptions (e.g., labels and local names) of URIs. We also propose a trustworthiness-based method to rank the coreferent URIs in the kernel as well as a similarity-based method for ranking the URIs in the extension of the kernel. We implement the proposed approach, called ObjectCoref, on a large-scale dataset that contains 76 million URIs collected by the Falcons search engine until 2008. The evaluation on precision, relative recall and response time demonstrates the feasibility of our approach. Additionally, we apply the proposed approach to investigate the popularity of the URI alias phenomenon on the current Semantic Web.
Falcon-AO: A Practical Ontology Matching System.

Wei Hu,Yuzhong Qu

DOI: https://doi.org/10.1016/j.websem.2008.02.006

2008-01-01

SSRN Electronic Journal

Abstract:In this paper, we introduce a general overview of Falcon-AO: a practical ontology matching system with acceptable to good performance and a number of remarkable features. Furthermore, Falcon-AO is one of the best systems in all kinds of tests in the latest three years' OAEI campaigns. Falcon-AO is written in Java, and is open source.
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution

Ankita Gupta,Marzena Karpinska,Wenlong Zhao,Kalpesh Krishna,Jack Merullo,Luke Yeh,Mohit Iyyer,Brendan O'Connor

DOI: https://doi.org/10.48550/arXiv.2210.07188

2022-10-14

Abstract:Large-scale, high-quality corpora are critical for advancing research in coreference resolution. However, existing datasets vary in their definition of coreferences and have been collected via complex and lengthy guidelines that are curated for linguistic experts. These concerns have sparked a growing interest among researchers to curate a unified set of guidelines suitable for annotators with various backgrounds. In this work, we develop a crowdsourcing-friendly coreference annotation methodology, ezCoref, consisting of an annotation tool and an interactive tutorial. We use ezCoref to re-annotate 240 passages from seven existing English coreference datasets (spanning fiction, news, and multiple other domains) while teaching annotators only cases that are treated similarly across these datasets. Surprisingly, we find that reasonable quality annotations were already achievable (>90% agreement between the crowd and expert annotations) even without extensive training. On carefully analyzing the remaining disagreements, we identify the presence of linguistic cases that our annotators unanimously agree upon but lack unified treatments (e.g., generic pronouns, appositives) in existing datasets. We propose the research community should revisit these phenomena when curating future unified annotation guidelines.

Computation and Language
FalconAO: Aligning Ontologies with Falcon.

Ningsheng Jian,Wei Hu,Gong Cheng,Yuzhong Qu

2005-01-01

Abstract:Falcon-AO is an automatic tool for aligning ontologies. There are two matchers integrated in Falcon-AO: one is a matcher based on linguistic matching for ontologies, called LMO; the other is a matcher based on graph matching for ontologies, called GMO. In Falcon-AO, GMO takes the alignments generated by LMO as external input and outputs additional alignments. Reliable alignments are gained through LMO as well as GMO according to the concept of reliability. The reliability is obtained by observing the linguistic comparability and structural comparability of the two ontologies being compared. We have performed Falcon-AO on tests provided by OAEI 2005 campaign and got some preliminary results. In this paper, we describe the architecture and techniques of Falcon-AO in brief and present our results in more details. Finally, comments about test cases and lessons learnt from the campaign will be presented.
ETS: An Error Tolerable System for Coreference Resolution.

Hao Xiong,Linfeng Song,Fandong Meng,Yang Liu,Qun Liu,Yajuan Lv

2011-01-01

Abstract:This paper presents our error tolerable system for coreference resolution in CoNLL-2011 (Pradhan et al., 2011) shared task (closed track). Different from most previous reported work, we detect mention candidates based on packed forest instead of single parse tree, and we use beam search algorithm based on the Bell Tree to create entities. Experimental results show that our methods achieve promising results on the development set.
Resolving Object Coreference in Semantic Web Based on MapReduce

XIE Junkai,HU Wei,BAI Wenyang

DOI: https://doi.org/10.3778/j.issn.1673-9418.2012.04.002

2012-01-01

Abstract:Object coreference resolution is a hotspot topic in the research area of the semantic Web.Although there are many novel approaches for resolving object coreference,their efficiency is still far away from practical use.At present,the MapReduce framework is widely used for processing data because of its simplicity and higher computational capability with lower cost.This paper proposes two parallel algorithms in terms of different phases of MapReduce to resolve object coreference in the semantic Web.Specifically,given a labeled training set and a threshold,the algorithms can efficiently find the most discriminative properties whose confidences are no less than the predefined threshold.These discriminative properties are used to identify object coreference holding similar values.The paper reports the results from experiments on real datasets,by increasing the dataset size,to evaluate the speed-up and scale-up properties of the proposed algorithms using MapReduce.
Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles

K. Bretonnel Cohen,Arrick Lanfranchi,Miji Joo-young Choi,Michael Bada,William A. Baumgartner,Natalya Panteleyeva,Karin Verspoor,Martha Palmer,Lawrence E. Hunter

DOI: https://doi.org/10.1186/s12859-017-1775-9

IF: 3.307

2017-08-17

BMC Bioinformatics

Abstract:BackgroundCoreference resolution is the task of finding strings in text that have the same referent as other strings. Failures of coreference resolution are a common cause of false negatives in information extraction from the scientific literature. In order to better understand the nature of the phenomenon of coreference in biomedical publications and to increase performance on the task, we annotated the Colorado Richly Annotated Full Text (CRAFT) corpus with coreference relations.ResultsThe corpus was manually annotated with coreference relations, including identity and appositives for all coreferring base noun phrases. The OntoNotes annotation guidelines, with minor adaptations, were used. Interannotator agreement ranges from 0.480 (entity-based CEAF) to 0.858 (Class-B3), depending on the metric that is used to assess it. The resulting corpus adds nearly 30,000 annotations to the previous release of the CRAFT corpus. Differences from related projects include a much broader definition of markables, connection to extensive annotation of several domain-relevant semantic classes, and connection to complete syntactic annotation. Tool performance was benchmarked on the data. A publicly available out-of-the-box, general-domain coreference resolution system achieved an F-measure of 0.14 (B3), while a simple domain-adapted rule-based system achieved an F-measure of 0.42. An ensemble of the two reached F of 0.46. Following the IDENTITY chains in the data would add 106,263 additional named entities in the full 97-paper corpus, for an increase of 76% percent in the semantic classes of the eight ontologies that have been annotated in earlier versions of the CRAFT corpus.ConclusionsThe project produced a large data set for further investigation of coreference and coreference resolution in the scientific literature. The work raised issues in the phenomenon of reference in this domain and genre, and the paper proposes that many mentions that would be considered generic in the general domain are not generic in the biomedical domain due to their referents to specific classes in domain-specific ontologies. The comparison of the performance of a publicly available and well-understood coreference resolution system with a domain-adapted system produced results that are consistent with the notion that the requirements for successful coreference resolution in this genre are quite different from those of the general domain, and also suggest that the baseline performance difference is quite large.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Learning Event-aware Measures for Event Coreference Resolution.

Yao,Zuchao Li,Hai Zhao

DOI: https://doi.org/10.18653/v1/2023.findings-acl.855

2023-01-01

Abstract:Researchers are witnessing knowledge-inspired natural language processing shifts the focus from entity-level to event-level, whereas event coreference resolution is one of the core challenges.This paper proposes a novel model for within-document event coreference resolution.On the basis of event but not entity as before, our model learns and integrates multiple representations from both event alone and event pair.For the former, we introduce multiple linguistics-motivated event alone features for more discriminative event representations.For the latter, we consider multiple similarity measures to capture the distinctions of event pairs.Our proposed model achieves new state-of-theart on the ACE 2005 benchmark, demonstrating the effectiveness of our proposed framework.
Tracing Origins: Coref-aware Machine Reading Comprehension

Baorong Huang,Zhuosheng Zhang,Hai Zhao

DOI: https://doi.org/10.18653/v1/2022.acl-long.91

2021-01-01

Abstract: Machine reading comprehension is a heavily-studied research and test field for evaluating new pre-trained models and fine-tuning strategies, and recent studies have enriched the pre-trained models with syntactic, semantic and other linguistic information to improve the performance of the model. In this paper, we imitated the human's reading process in connecting the anaphoric expressions and explicitly leverage the coreference information to enhance the word embeddings from the pre-trained model, in order to highlight the coreference mentions that must be identified for coreference-intensive question answering in QUOREF, a relatively new dataset that is specifically designed to evaluate the coreference-related performance of a model. We used an additional BERT layer to focus on the coreference mentions, and a Relational Graph Convolutional Network to model the coreference relations. We demonstrated that the explicit incorporation of the coreference information in fine-tuning stage performed better than the incorporation of the coreference information in training a pre-trained language models.
CORE: Cooperative Reconstruction for Multi-Agent Perception

Binglu Wang,Lei Zhang,Zhaozhong Wang,Yongqiang Zhao,Tianfei Zhou

2023-07-25

Abstract:This paper presents CORE, a conceptually simple, effective and communication-efficient model for multi-agent cooperative perception. It addresses the task from a novel perspective of cooperative reconstruction, based on two key insights: 1) cooperating agents together provide a more holistic observation of the environment, and 2) the holistic observation can serve as valuable supervision to explicitly guide the model learning how to reconstruct the ideal observation based on collaboration. CORE instantiates the idea with three major components: a compressor for each agent to create more compact feature representation for efficient broadcasting, a lightweight attentive collaboration component for cross-agent message aggregation, and a reconstruction module to reconstruct the observation based on aggregated feature representations. This learning-to-reconstruct idea is task-agnostic, and offers clear and reasonable supervision to inspire more effective collaboration, eventually promoting perception tasks. We validate CORE on OPV2V, a large-scale multi-agent percetion dataset, in two tasks, i.e., 3D object detection and semantic segmentation. Results demonstrate that the model achieves state-of-the-art performance on both tasks, and is more communication-efficient.

Computer Vision and Pattern Recognition
Team RUC_AIM3 Technical Report at ActivityNet 2021: Entities Object Localization

Ludan Ruan,Jieting Chen,Yuqing Song,Shizhe Chen,Qin Jin

DOI: https://doi.org/10.48550/arXiv.2106.06138

2021-06-11

Abstract:Entities Object Localization (EOL) aims to evaluate how grounded or faithful a description is, which consists of caption generation and object grounding. Previous works tackle this problem by jointly training the two modules in a framework, which limits the complexity of each module. Therefore, in this work, we propose to divide these two modules into two stages and improve them respectively to boost the whole system performance. For the caption generation, we propose a Unified Multi-modal Pre-training Model (UMPM) to generate event descriptions with rich objects for better localization. For the object grounding, we fine-tune the state-of-the-art detection model MDETR and design a post processing method to make the grounding results more faithful. Our overall system achieves the state-of-the-art performances on both sub-tasks in Entities Object Localization challenge at Activitynet 2021, with 72.57 localization accuracy on the testing set of sub-task I and 0.2477 F1_all_per_sent on the hidden testing set of sub-task II.

Computer Vision and Pattern Recognition
Investigating Multilingual Coreference Resolution by Universal Annotations

Haixia Chai,Michael Strube

2023-10-27

Abstract:Multilingual coreference resolution (MCR) has been a long-standing and challenging task. With the newly proposed multilingual coreference dataset, CorefUD (Nedoluzhko et al., 2022), we conduct an investigation into the task by using its harmonized universal morphosyntactic and coreference annotations. First, we study coreference by examining the ground truth data at different linguistic levels, namely mention, entity and document levels, and across different genres, to gain insights into the characteristics of coreference across multiple languages. Second, we perform an error analysis of the most challenging cases that the SotA system fails to resolve in the CRAC 2022 shared task using the universal annotations. Last, based on this analysis, we extract features from universal morphosyntactic annotations and integrate these features into a baseline system to assess their potential benefits for the MCR task. Our results show that our best configuration of features improves the baseline by 0.9% F1 score.

Computation and Language
Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUD

Ondřej Pražák,Miloslav Konopík

2024-09-22

Abstract:Coreference resolution, the task of identifying expressions in text that refer to the same entity, is a critical component in various natural language processing (NLP) applications. This paper presents our end-to-end neural coreference resolution system, utilizing the CorefUD 1.1 dataset, which spans 17 datasets across 12 languages. Our model is based on the end-to-end neural coreference resolution system. We first establish strong baseline models, including monolingual and cross-lingual variations, and then propose several extensions to enhance performance across diverse linguistic contexts. These extensions include cross-lingual training, incorporation of syntactic information, a Span2Head model for optimized headword prediction, and advanced singleton modeling. We also experiment with headword span representation and long-document modeling through overlapping segments. The proposed extensions, particularly the heads-only approach, singleton modeling, and long document prediction, significantly improve performance across most datasets. We also perform zero-shot cross-lingual experiments, highlighting the potential and limitations of cross-lingual transfer in coreference resolution. Our findings contribute to the development of robust and scalable coreference systems for multilingual coreference resolution. Finally, we evaluate our model on the CorefUD 1.1 test set and surpass the best model from the CRAC 2023 shared task of comparable size by a large margin. Our model is available on GitHub: <a class="link-external link-https" href="https://github.com/ondfa/coref-multiling" rel="external noopener nofollow">this https URL</a>

Computation and Language,Machine Learning
A Real-Time Cross-Modality Correlation Filtering Method for Referring Expression Comprehension

Yue Liao,Si Liu,Guanbin Li,Fei Wang,Yanjie Chen,Chen Qian,Bo Li

DOI: https://doi.org/10.1109/cvpr42600.2020.01089

2020-06-01

Abstract:Referring expression comprehension aims to localize the object instance described by a natural language expression. Current referring expression methods have achieved good performance. However, none of them is able to achieve realtime inference without accuracy drop. The reason for the relatively slow inference speed is that these methods artificially split the referring expression comprehension into two sequential stages including proposal generation and proposal ranking. It does not exactly conform to the habit of human cognition. To this end, we propose a novel Realtime Cross-modality Correlation Filtering method (RCCF). RCCF reformulates the referring expression comprehension as a correlation filtering process. The expression is first mapped from the language domain to the visual domain and then treated as a template (kernel) to perform correlation filtering on the image feature map. The peak value in the correlation heatmap indicates the center points of the target box. In addition, RCCF also regresses a 2-D object size and 2-D offset. The center point coordinates, object size and center point offset together to form the target bounding box. Our method runs at 40 FPS while achieving leading performance in RefClef, RefCoCo,RefCOCO+ and Ref-COCOg benchmarks. In the challenging RefClef dataset, our methods almost double the state-of-the-art performance (34.70% increased to 63.79%). We hope this work can arouse more attention and studies to the new cross-modality correlation filtering framework as well as the one-stage framework for referring expression comprehension.
ObjectRelator: Enabling Cross-View Object Relation Understanding in Ego-Centric and Exo-Centric Videos

Yuqian Fu,Runze Wang,Yanwei Fu,Danda Pani Paudel,Xuanjing Huang,Luc Van Gool

2024-11-28

Abstract:In this paper, we focus on the Ego-Exo Object Correspondence task, an emerging challenge in the field of computer vision that aims to map objects across ego-centric and exo-centric views. We introduce ObjectRelator, a novel method designed to tackle this task, featuring two new modules: Multimodal Condition Fusion (MCFuse) and SSL-based Cross-View Object Alignment (XObjAlign). MCFuse effectively fuses language and visual conditions to enhance target object localization, while XObjAlign enforces consistency in object representations across views through a self-supervised alignment strategy. Extensive experiments demonstrate the effectiveness of ObjectRelator, achieving state-of-the-art performance on Ego2Exo and Exo2Ego tasks with minimal additional parameters. This work provides a foundation for future research in comprehensive cross-view object relation understanding highlighting the potential of leveraging multimodal guidance and cross-view alignment. Codes and models will be released to advance further research in this direction.

Computer Vision and Pattern Recognition,Artificial Intelligence
RiMOM Results for OAEI 2010

Zhichun Wang,Xiao Zhang,Lei Hou,Yue Zhao,Juanzi Li,Yu Qi,Jie Tang

2010-01-01

Abstract:This paper presents the results of RiMOM in the Ontology Alignment Evaluation Initiative (OAEI) 2010. We participate in three tracks of the campaign: Benchmark, IM@OAEI2010 (IMEI), and Very Large Crosslingual Resources (VLCR). We first describe the basic alignment process and alignment strategies in RiMOM, and then we present specific techniques used for different tracks. At last we give some comments on our results and discuss some future work on RiMOM.

ObjectCoref & Falcon-AO: Results for OAEI 2010.

Falcon-AO: Results for OAEI 2007

The Results of Falcon-AO in the OAEI 2006 Campaign.

A Self-Training Approach for Resolving Object Coreference on the Semantic Web

Bootstrapping Object Coreferencing on the Semantic Web

Falcon-AO: A Practical Ontology Matching System.

ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution

FalconAO: Aligning Ontologies with Falcon.

ETS: An Error Tolerable System for Coreference Resolution.

Resolving Object Coreference in Semantic Web Based on MapReduce

Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles

Learning Event-aware Measures for Event Coreference Resolution.

Tracing Origins: Coref-aware Machine Reading Comprehension

CORE: Cooperative Reconstruction for Multi-Agent Perception

Team RUC_AIM3 Technical Report at ActivityNet 2021: Entities Object Localization

Investigating Multilingual Coreference Resolution by Universal Annotations

Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUD

A Real-Time Cross-Modality Correlation Filtering Method for Referring Expression Comprehension

ObjectRelator: Enabling Cross-View Object Relation Understanding in Ego-Centric and Exo-Centric Videos

RiMOM Results for OAEI 2010