Falcon-AO: Results for OAEI 2007

Wei Hu,Yuanyuan Zhao,Dan Li,Gong Cheng,Honghan Wu,Yuzhong Qu

2007-01-01

Abstract:In this paper, we present a brief overview of Falcon-AO (version 0.7): a practical ontology matching system with acceptable to very good performance, a flexible architecture, and a number of unique features. We also show some pre- liminary results of Falcon-AO for this year's OAEI campaign: evaluation on seven different matching tasks.

What problem does this paper attempt to address?

Falcon-AO: A Practical Ontology Matching System.

Wei Hu,Yuzhong Qu

DOI: https://doi.org/10.1016/j.websem.2008.02.006

2008-01-01

SSRN Electronic Journal

Abstract:In this paper, we introduce a general overview of Falcon-AO: a practical ontology matching system with acceptable to good performance and a number of remarkable features. Furthermore, Falcon-AO is one of the best systems in all kinds of tests in the latest three years' OAEI campaigns. Falcon-AO is written in Java, and is open source.
The Results of Falcon-AO in the OAEI 2006 Campaign.

Wei Hu,Gong Cheng,Dongdong Zheng,Xinyu Zhong,Yuzhong Qu

2006-01-01

Abstract:In this paper, we briefly introduce the architecture of Falcon-AO (version 0.6) and highlight two major improvements in the current version. Falcon-AO successfully completes all the five alignment tasks in the OAEI 2006 campaign: benchmark, anatomy, directory, food, and conference, and some preliminary results are also reported in this paper. In the end, we present some comments about our results and lessons learnt from the campaign towards building a comprehensive ontology alignment system.
FalconAO: Aligning Ontologies with Falcon.

Ningsheng Jian,Wei Hu,Gong Cheng,Yuzhong Qu

2005-01-01

Abstract:Falcon-AO is an automatic tool for aligning ontologies. There are two matchers integrated in Falcon-AO: one is a matcher based on linguistic matching for ontologies, called LMO; the other is a matcher based on graph matching for ontologies, called GMO. In Falcon-AO, GMO takes the alignments generated by LMO as external input and outputs additional alignments. Reliable alignments are gained through LMO as well as GMO according to the concept of reliability. The reliability is obtained by observing the linguistic comparability and structural comparability of the two ontologies being compared. We have performed Falcon-AO on tests provided by OAEI 2005 campaign and got some preliminary results. In this paper, we describe the architecture and techniques of Falcon-AO in brief and present our results in more details. Finally, comments about test cases and lessons learnt from the campaign will be presented.
ObjectCoref & Falcon-AO: Results for OAEI 2010.

Wei Hu,Jianfeng Chen,Gong Cheng,Yuzhong Qu

2010-01-01

Abstract:In this report, we mainly present an overview of ObjectCoref, which follows a self-training framework to resolve object coreference on the Semantic Web. Besides, we show preliminary results of Falcon-AO (2010) for this year's OAEI campaign, including the benchmark and conference tracks.
Evaluating Ontology Matching Systems on Large, Multilingual and Real-world Test Cases

Christian Meilicke,Ondrej Sváb-Zamazal,Cássia Trojahn,Ernesto Jiménez-Ruiz,José-Luis Aguirre,Heiner Stuckenschmidt,Bernardo Cuenca Grau

DOI: https://doi.org/10.48550/arXiv.1208.3148

2012-08-15

Abstract:In the field of ontology matching, the most systematic evaluation of matching systems is established by the Ontology Alignment Evaluation Initiative (OAEI), which is an annual campaign for evaluating ontology matching systems organized by different groups of researchers. In this paper, we report on the results of an intermediary OAEI campaign called OAEI 2011.5. The evaluations of this campaign are divided in five tracks. Three of these tracks are new or have been improved compared to previous OAEI campaigns. Overall, we evaluated 18 matching systems. We discuss lessons learned, in terms of scalability, multilingual issues and the ability do deal with real world cases from different domains.

Artificial Intelligence
LILY: the Results for the Ontology Alignment Contest OAEI 2007

Peng Wang,Baowen Xu

2007-01-01

Abstract:This paper presents the results of LILY, which is an ontology mapping system, for OAEI 2007 campaign. To accurately describe what the real meaning of an entity in the original ontology is, LILY extracts a semantic subgraph for each entity. Then it exploits both linguistic and structural information in semantic subgraphs to generate initial alignments. If necessary, using these initial results as input, a subsequent similarity propagation strategy could produce more alignments, which often can not be obtained by the previous process. The preliminary results of the experiments for four tasks (i.e. benchmark, directories, anatomy and conference) are presented. The discussion of the results and future work of LILY are also given.
Falcons Concept Search: A Practical Search Engine for Web Ontologies

Yuzhong Qu,Gong Cheng

DOI: https://doi.org/10.1109/tsmca.2011.2132705

2011-01-01

Abstract:Web ontologies provide shared concepts for describing domain entities and thus enable semantic interoperability between applications. To facilitate concept sharing and ontology reusing, we developed Falcons Concept Search, a novel keyword-based ontology search engine. In this paper, we illustrate how the proposed mode of interaction helps users quickly find ontologies that satisfy their needs and present several supportive techniques including a new method of constructing virtual documents of concepts for keyword search, a popularity-based scheme to rank concepts and ontologies, and a way to generate query-relevant structured snippets. We also report the results of a usability evaluation as well as user feedback.
Lily: Ontology Alignment Results for OAEI 2008.

Peng Wang,Baowen Xu

2008-01-01

Abstract:This paper presents the alignment results of Lily for the ontology alignment contest OAEI 2008. Lily is an ontology mapping system, and it has four main features: generic ontology matching, large scale ontology matching, semantic ontology matching and mapping debugging. In the past year, Lily has been improved greatly for both function and performance. In OAEI 2008, Lily submited the results for seven alignment tasks: benchmark, anatomy, fao, directory, mldirectory, library and conference. The specific techniques used by Lily are introduced briefly. The strengths and weaknesses of Lily are also discussed.
Searching Linked Objects With Falcons: Approach, Implementation And Evaluation

Gong Cheng,Yuzhong Qu

DOI: https://doi.org/10.4018/978-1-60960-593-3.ch010

2011-01-01

Abstract:The rapid development of the data Web is accompanied by increasing information needs from ordinary Web users for searching objects and their relations. To meet the challenge, this chapter presents Falcons Object Search, a keyword-based search engine for linked objects. To support various user needs expressed via keyword queries, for each object an extensive virtual document is indexed, which consists of not only associated literals but also the textual descriptions of associated links and linked objects. The resulting objects are ranked according to a combination of their relevance to the query and their popularity. For each resulting object, a query-relevant structured snippet is provided to show the associated literals and linked objects matched with the query for reflecting query relevance and even directly answering the question behind the query. To exploit ontological semantics for more precise search results, the type information of objects is leveraged to support class-based query refinement, and Web-scale class-inclusion reasoning is performed to discover implicit type information. Further, a subclass recommendation technique is proposed to allow users navigate class hierarchies for incremental results filtering. A task-based experiment demonstrates the promising features of the system.
SPECIAL AREA ORIENTED SEMANTIC SEARCH RESULTS RANKING ALGORITHM

Yang Kete,Chen Huajun

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.12.051

2011-01-01

Abstract:In order to improve the accuracy of semantic search oriented towards special areas,after analyzing existing ontology ranking algorithms,the importance of present TCM ontology is evaluated.Meanwhile after calculating the matching degree between searching Key words and results,the ranking result after comprehensive evaluation is presented.Experimental results show that the algorithm provides a comparatively reasonable ranking result which better meets user requirements.
Agent-OM: Leveraging LLM Agents for Ontology Matching

Zhangcheng Qiang,Weiqing Wang,Kerry Taylor

2024-07-29

Abstract:Ontology matching (OM) enables semantic interoperability between different ontologies and resolves their conceptual heterogeneity by aligning related entities. OM systems currently have two prevailing design paradigms: conventional knowledge-based expert systems and newer machine learning-based predictive systems. While large language models (LLMs) and LLM agents have revolutionised data engineering and have been applied creatively in many domains, their potential for OM remains underexplored. This study introduces a novel agent-powered LLM-based design paradigm for OM systems. With consideration of several specific challenges in leveraging LLM agents for OM, we propose a generic framework, namely Agent-OM (w.r.t. Agent for Ontology Matching), consisting of two Siamese agents for retrieval and matching, with a set of simple OM tools. Our framework is implemented in a proof-of-concept system. Evaluations of three Ontology Alignment Evaluation Initiative (OAEI) tracks over state-of-the-art OM systems show that our system can achieve results very close to the long-standing best performance on simple OM tasks and can significantly improve the performance on complex and few-shot OM tasks.

Artificial Intelligence,Computation and Language,Information Retrieval
RiMOM2013 Results for OAEI 2013.

Qian Zheng,Chao Shao,Juanzi Li,Zhichun Wang,Linmei Hu

2013-01-01

Abstract:This paper presents the results of RiMOM2013 in the Ontology Alignment Evaluation Initiative (OAEI) 2013. We participated in three tracks of the tasks: Benchmark, IM@OAEI2013, and Multifarm. We first describe the basic framework of our matching System (RiMOM2013); then we describe the alignment process and alignment strategies of RiMOM2013, and then we present specific techniques used for different tracks. At last we give some comments on our results and discuss some future work on RiMOM2013.
Searching Linked Objects with Falcons

Gong Cheng,Yuzhong Qu

DOI: https://doi.org/10.4018/jswis.2009081903

2009-01-01

International Journal on Semantic Web and Information Systems

Abstract:Along with the rapid growth of the data Web, searching linked objects for information needs and for reusing become emergent for ordinary Web users and developers, respectively. To meet the challenge, we present Falcons Object Search, a keyword-based search engine for linked objects. To serve various keyword queries, for each object the system constructs a comprehensive virtual document including not only associated literals but also the textual descriptions of associated links and linked objects. The resulting objects are ranked by considering both their relevance to the query and their popularity. For each resulting object, a query-relevant structured snippet is provided to show the associated literals and linked objects matched with the query. Besides, Web-scale class-inclusion reasoning is performed to discover implicit typing information, and users could navigate class hierarchies for incremental class-based results filtering. The results of a task-based experiment show the promising features of the system.
Lily: Ontology Alignment Results for OAEI 2009.

Peng Wang,Baowen Xu

2009-01-01

Abstract:This paper presents the alignment results of Lily for the ontology alignment contest OAEI 2009. Lily is an ontology mapping system, and it has four functions: generic ontology matching, large scale ontology matching, semantic ontology matching and mapping debugging. In OAEI 2009, Lily submited the results for four alignment tasks: benchmark, anatomy, directory and conference.
RiMOM-IM Results for OAEI 2014

Chao Shao,Linmei Hu,Juanzi Li

2014-01-01

Abstract:This paper presents the results of RiMOM-IM in the Ontology Alignment Evaluation Initiative (OAEI) 2014. We only participated in IM@OAEI2014. We first describe the overall framework of our matching System (RiMOM-IM); then we detail the techniques used in the framework for instance matching. Last, we give a thorough analysis on our results and discuss some future work on RiMOM-IM.
RiMOM Results for OAEI 2010

Zhichun Wang,Xiao Zhang,Lei Hou,Yue Zhao,Juanzi Li,Yu Qi,Jie Tang

2010-01-01

Abstract:This paper presents the results of RiMOM in the Ontology Alignment Evaluation Initiative (OAEI) 2010. We participate in three tracks of the campaign: Benchmark, IM@OAEI2010 (IMEI), and Very Large Crosslingual Resources (VLCR). We first describe the basic alignment process and alignment strategies in RiMOM, and then we present specific techniques used for different tracks. At last we give some comments on our results and discuss some future work on RiMOM.
Testing the AgreementMaker System in the Anatomy Task of OAEI 2012

Daniel Faria,Catia Pesquita,Emanuel Santos,Francisco M. Couto,Cosmin Stroe,Isabel F. Cruz

DOI: https://doi.org/10.48550/arXiv.1212.1625

2012-12-07

Abstract:The AgreementMaker system was the leading system in the anatomy task of the Ontology Alignment Evaluation Initiative (OAEI) competition in 2011. While AgreementMaker did not compete in OAEI 2012, here we report on its performance in the 2012 anatomy task, using the same configurations of AgreementMaker submitted to OAEI 2011. Additionally, we also test AgreementMaker using an updated version of the UBERON ontology as a mediating ontology, and otherwise identical configurations. AgreementMaker achieved an F-measure of 91.8% with the 2011 configurations, and an F-measure of 92.2% with the updated UBERON ontology. Thus, AgreementMaker would have been the second best system had it competed in the anatomy task of OAEI 2012, and only 0.1% below the F-measure of the best system.

Information Retrieval,Artificial Intelligence
RiMOM Results for OAEI 2015

Yan Zhang,Juanzi Li

2015-01-01

Abstract:This paper presents the results of RiMOM in the Ontology Align- ment Evaluation Initiative (OAEI) 2015. We only participated in Instance Match- ing@OAEI2015. We first describe the overall framework of our matching Sys- tem (RiMOM); then we detail the techniques used in the framework for instance matching. Last, we give a thorough analysis on our results and discuss some fu- ture work on RiMOM.
OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching

Zhangcheng Qiang,Kerry Taylor,Weiqing Wang,Jing Jiang

2024-10-21

Abstract:Hallucinations of large language models (LLMs) commonly occur in domain-specific downstream tasks, with no exception in ontology matching (OM). The prevalence of using LLMs for OM raises the need for benchmarks to better understand LLM hallucinations. The OAEI-LLM dataset is an extended version of the Ontology Alignment Evaluation Initiative (OAEI) datasets that evaluate LLM-specific hallucinations in OM tasks. We outline the methodology used in dataset construction and schema extension, and provide examples of potential use cases.

Artificial Intelligence,Computation and Language,Information Retrieval

Falcon-AO: Results for OAEI 2007

Falcon-AO: A Practical Ontology Matching System.

The Results of Falcon-AO in the OAEI 2006 Campaign.

FalconAO: Aligning Ontologies with Falcon.

ObjectCoref & Falcon-AO: Results for OAEI 2010.

Evaluating Ontology Matching Systems on Large, Multilingual and Real-world Test Cases

LILY: the Results for the Ontology Alignment Contest OAEI 2007

Falcons Concept Search: A Practical Search Engine for Web Ontologies

Lily: Ontology Alignment Results for OAEI 2008.

Searching Linked Objects With Falcons: Approach, Implementation And Evaluation

SPECIAL AREA ORIENTED SEMANTIC SEARCH RESULTS RANKING ALGORITHM

Agent-OM: Leveraging LLM Agents for Ontology Matching

RiMOM2013 Results for OAEI 2013.

Searching Linked Objects with Falcons

Lily: Ontology Alignment Results for OAEI 2009.

RiMOM-IM Results for OAEI 2014

RiMOM Results for OAEI 2010

Testing the AgreementMaker System in the Anatomy Task of OAEI 2012

RiMOM Results for OAEI 2015

OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching