PRIS at TAC2012 KBP Track.

Yan Li,Sijia Chen,Zhihua Zhou,Jie Yin,Hao Luo,Liyin Hong,Weiran Xu,Guang Chen,Jun Guo

2012-01-01

Abstract:Our method to Knowledge Base Population at TAC2012 is described in this paper. An enhanced pattern bootstrapping system is mainly utilized in the Slot Filling task. And for the Entity Linking task, query expansion method, rule-based method and entity similarity ranking strategy are combined.

What problem does this paper attempt to address?

ICL KBP Approaches to Knowledge Base Population at TAC2010

Yang Song,Zhengyan He,Houfeng Wang

2010-01-01

Abstract:This paper reports the ICL KBP team participated in the TAC2010-Knowledge Base Popolation Track. We submitted results for Entity Linking task and Slot Filling task. For Entity Linking, we implemented a simple unsupervised method to select the candidate entities in the Wikipedia Reference Knowledge Base for the given query document which describes the query name-string. For Slot Filling, we treat it as a binary classification problem for each candidate slot value and use type constraint to filter the results. Experimental results reveals that our method reaches the median values of all participants for both tasks.
Collective Entity Linking and a Simple Slot Filling Method for TAC-KBP 2011.

Zhengyan He,Houfeng Wang

2011-01-01

Abstract:This paper summarize our work in TAC2010 knowledge base population track. We submit result for english entity linking and regular slot filling task. For entity linking we use a frequency based method as baseline and implement a collective method following (Han et al., 2011) for entity linking. For slot filling, we use wikipedia infobox as a source of supervision by mapping back to sentences to generate more training sentences. Evaluation result shows the strength and weakness of both our approaches.
OpenKN at TAC KBP 2016.

Manling Li,Xinlei Chen,Yantao Jia,Yuanzhuo Wang,Xiaolong Jin,Zixuan Li,Juan Yao,Fan Yang,Yunqi Qiu,Jialin Su,Xueqi Cheng

2016-01-01

Theory and applications of categories

Abstract:This paper describes the system OpenKN which we established in the TAC KBP 2016. In TAC KBP 2016, we participated in one track: Cold Start KB Track. In order to complete the task, we developed a fivestep system which solves the problem of building knowledge base from a document collection of unstructured text. These five steps to complete this task are documentprocessing, relation extraction, crossdocument co-reference resolution, inference, and post-processing, where the relation extractor is the combination of four methods: rule-based pattern extractor, bootstrapping, OpenIE and an Implicit Relation Information Extractor.
NLPComp in TAC 2012 Entity Linking and Slot-Filling.

Jian Xu,Qin Lu,Jie Liu,Ruifeng Xu

2012-01-01

Abstract:The NLPComp team participated in two TACKBP2012 tasks: Regular Entity Linking and Regular Slot Filling. For the entity linking task, a three-step entity linking system is developed. In the first step, a list of possible candidates are selected. Then the best candidate is identified to decide whether a link exists. In addition, a document clustering algorithm is used to group NIL queries. This system uses the Wikipedia anchor terms to enlarge the number of candidate instances. It then incorporates the topic modelling technique to select features of topical words. However, our system produces a poor answer coverage and the NIL detection system brings significant loss in the final Fscore. For the slot filling task, we developed a system which combines rule-based approach and multiple instance learning technique. In rulebased slot filling, a number of trigger words are collected from the English Wikipedia and the frequency feature is used to select final slot value(s). When extracting slot value(s) using the multiple instance learning technique, 2009 and 2010 KBP slot filling queries and manually annotated answers are used to create named entity pairs which exhibit a particular relation. Then bags of sentences containing named entity pair are extracted from the KBP source. Our system reaches the median level among all the participating systems.
THUNLP at TAC KBP 2011 in Entity Linking.

Yu Zhao,Weipeng He,Zhiyuan Liu,Maosong Sun

2011-01-01

Theory and applications of categories

Abstract:Entity Linking is to link a name string from plain-text documents to the corresponding entry in given knowledge base. In this paper we demonstrate our entity linking system for TAC KBP 2011 Track. Our system implements pairwise and listwise learning to rank methods to create a ranking list of candidates with several kinds of features, including context similarity, term frequency, key entity extraction and WikiPage information. We participate in entity linking and cross-lingual entity linking task. We use random forest to validate the top 1 candidate recommended by our system. We achieve a performance of 72.9% F1 measure for both two tasks.
ITNLP Entity Linking System at TAC 2013.

Yaming Sun,Xianqi Zou,Lei Lin,Chengjie Sun

2013-01-01

Abstract:This paper describes the ITNLP system participated in the Knowledge Base Population (KBP) track English Entity Linking task. Our Entity linking system is composed of three parts: candidate generation, candidate ranking and nil clustering. In the candidate generation process, the redirect pages and anchor texts in Wikipedia are utilized to generate candidate entities for the mentions. Ranking SVM is adopted to rank the candidates by a set of linguistic features. In the end, the hierarchical clustering algorithm is used to cluster those queries which return NIL in the ranking process.
HIT Approaches to Entity Linking at TAC 2012.

Yuhang Guo,Bing Qin,Ting Liu,Sheng Li

2012-01-01

Theory and applications of categories

Abstract:This paper describes the system of HIT at the 2011 Text Analysis Conference (TAC) Knowledge Base Population (KBP) track English Entity Linking task. In this task, a system is required to link a name string in a given contextual document to its referent entity in an external knowledge base. The HIT system makes the linkage by using the relatedness score between the context and the model of the entity. In this system, an entity is modeled based on its information from Wikipedia. The relatedness score contains three parts: the popularity of the entity along with the query name, the context language model score which is generated by the entity model and the occurrence of the aliases of the entity. The evaluation result shows the system performance is comparable with the median performance of the participating systems.
HIT Approaches to Entity Linking at TAC 2011.

Yuhang Guo,Guohua Tang,Wanxiang Che,Ting Liu,Sheng Li

2011-01-01

Abstract:This paper describes the system of HIT at the 2011 Text Analysis Conference (TAC) Knowledge Base Population (KBP) track English Entity Linking task. Based on structured and unstructured information extracted from Wikipedia, this system predicts the most probable entity that a query mention might refer to. A similarity score is assigned to the candidate entity by computing the the relatedness between the query and the entity, and augmented by the popularity of the entity. We model the query context as a graph of the entities and utilize the referential relationship between the context entities and the candidate entities in Wikipedia to measure the relatedness between the query context and the candidate entity. Evaluation results show the performance of our system reaches the median value of all the participating systems.
PKUTM Participation at TAC 2010 RTE and Summarization Track.

Houping Jia,Xiaojiang Huang,Tengfei Ma,Xiaojun Wan,Jianguo Xiao

2010-01-01

Abstract:This paper describes the systems of PKUTM in Text Analysis Conference (TAC) 2010. We participated in the Recognizing Textual Entailment (RTE) track and the Summarization track. For the RTE track, we propose a method to map every node in the hypothesis to one or more nodes in the text. With the help of named-entities tools, MINIPAR relationships, and regular patterns to recognize temporal and numeric expressions, some nodes are merged into one node. We transform the hypothesis by using semantic knowledge from sources like WordNet, VerbOcean, and LingPipe. In the Summarization track, we propose a unified framework for both kinds of summarization. We employ a manifold-ranking model to select sentences and a novel sentence ordering method to generate final summaries. The underlying idea of the proposed approach is that a good summary is expected to include the sentences with both high biased information richness and high information novelty. The evaluation results show that our proposed two frameworks are very effective for RTE and Summarization tasks, respectively.
CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

Yating Liu,Yaowei Li,Zimo Liu,Wenming Yang,Yaowei Wang,Qingmin Liao

DOI: https://doi.org/10.48550/arXiv.2309.09496

2024-01-02

Abstract:Text-based Person Retrieval (TPR) aims to retrieve the target person images given a textual query. The primary challenge lies in bridging the substantial gap between vision and language modalities, especially when dealing with limited large-scale datasets. In this paper, we introduce a CLIP-based Synergistic Knowledge Transfer (CSKT) approach for TPR. Specifically, to explore the CLIP's knowledge on input side, we first propose a Bidirectional Prompts Transferring (BPT) module constructed by text-to-image and image-to-text bidirectional prompts and coupling projections. Secondly, Dual Adapters Transferring (DAT) is designed to transfer knowledge on output side of Multi-Head Attention (MHA) in vision and language. This synergistic two-way collaborative mechanism promotes the early-stage feature fusion and efficiently exploits the existing knowledge of CLIP. CSKT outperforms the state-of-the-art approaches across three benchmark datasets when the training parameters merely account for 7.4% of the entire model, demonstrating its remarkable efficiency, effectiveness and generalization.

Computer Vision and Pattern Recognition,Artificial Intelligence
Calculating Question Similarity is Enough: A New Method for KBQA Tasks

Hanyu Zhao,Sha Yuan,Jiahong Leng,Xiang Pan,Guoqiang Wang,Ledell Wu,Jie Tang

DOI: https://doi.org/10.48550/arXiv.2111.07658

2022-05-01

Abstract:Knowledge Base Question Answering (KBQA) aims to answer natural language questions with the help of an external knowledge base. The core idea is to find the link between the internal knowledge behind questions and known triples of the knowledge base. Traditional KBQA task pipelines contain several steps, including entity recognition, entity linking, answering selection, etc. In this kind of pipeline methods, errors in any procedure will inevitably propagate to the final prediction. To address this challenge, this paper proposes a Corpus Generation - Retrieve Method (CGRM) with Pre-training Language Model (PLM) for the KBQA task. The major novelty lies in the design of the new method, wherein our approach, the knowledge enhanced T5 (kT5) model aims to generate natural language QA pairs based on Knowledge Graph triples and directly solve the QA by retrieving the synthetic dataset. The new method can extract more information about the entities from PLM to improve accuracy and simplify the processes. We test our method on NLPCC-ICCPOL 2016 KBQA dataset, and the results show that our method improves the performance of KBQA and the out straight-forward method is competitive with the state-of-the-art.

Computation and Language,Artificial Intelligence
BTPK-based learning: An Interpretable Method for Named Entity Recognition

Yulin Chen,Zelai Yao,Haixiao Chi,Dov Gabbay,Bo Yuan,Bruno Bentzen,Beishui Liao

2022-01-01

Abstract: Named entity recognition (NER) is an essential task in natural language processing, but the internal mechanism of most NER models is a black box for users. In some high-stake decision-making areas, improving the interpretability of an NER method is crucial but challenging. In this paper, based on the existing Deterministic Talmudic Public announcement logic (TPK) model, we propose a novel binary tree model (called BTPK) and apply it to two widely used Bi-RNNs to obtain BTPK-based interpretable ones. Then, we design a counterfactual verification module to verify the BTPK-based learning method. Experimental results on three public datasets show that the BTPK-based learning outperform two classical Bi-RNNs with self-attention, especially on small, simple data and relatively large, complex data. Moreover, the counterfactual verification demonstrates that the explanations provided by the BTPK-based learning method are reasonable and accurate in NER tasks. Besides, the logical reasoning based on BTPK shows how Bi-RNNs handle NER tasks, with different distance of public announcements on long and complex sequences.
Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocols

Prachi Jain,Sushant Rathi,Mausam,Soumen Chakrabarti

DOI: https://doi.org/10.48550/arXiv.2005.05035

2020-05-02

Social and Information Networks

Abstract:Temporal knowledge bases associate relational (s,r,o) triples with a set of times (or a single time instant) when the relation is valid. While time-agnostic KB completion (KBC) has witnessed significant research, temporal KB completion (TKBC) is in its early days. In this paper, we consider predicting missing entities (link prediction) and missing time intervals (time prediction) as joint TKBC tasks where entities, relations, and time are all embedded in a uniform, compatible space. We present TIMEPLEX, a novel time-aware KBC method, that also automatically exploits the recurrent nature of some relations and temporal interactions between pairs of relations. TIMEPLEX achieves state-of-the-art performance on both prediction tasks. We also find that existing TKBC models heavily overestimate link prediction performance due to imperfect evaluation mechanisms. In response, we propose improved TKBC evaluation protocols for both link and time prediction tasks, dealing with subtle issues that arise from the partial overlap of time intervals in gold instances and system predictions.
Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

Renyu Zhu,Dongxiang Zhang,Chengcheng Han,Ming Gao,Xuesong Lu,Weining Qian,Aoying Zhou

DOI: https://doi.org/10.1109/ICDMW58026.2022.00048

2022-01-01

Abstract:In this paper, we study knowledge tracing in the domain of programming education and make two important contributions. First, we harvest and publish so far the most comprehensive dataset, namely BePKT, which covers various online behaviors in an online judge (OJ) system, including programming text problems, knowledge annotations, user-submitted code and system-logged events. Second, we propose a new model PDKT to exploit the enriched context for accurate student behavior prediction. More specifically, we construct a bipartite graph for programming problem embedding, and design an improved pre-training model PLCodeBERT for code embedding, as well as a double-sequence RNN model with exponential decay attention for effective feature fusion. Experimental results on the new dataset BePKT show that our proposed model establishes state-of-the-art performance in programming knowledge tracing. In addition, we verify that our code embedding strategy based on PLCodeBERT is complementary to existing knowledge tracing models to further enhance their accuracy. As a side product, PLCodeBERT also results in better performance in other programming-related tasks such as code clone detection.
BTPK-based Interpretable Method for NER Tasks Based on Talmudic Public Announcement Logic

Yulin Chen,Beishui Liao,Bruno Bentzen,Bo Yuan,Zelai Yao,Haixiao Chi,D. Gabbay

2022-01-01

Abstract:As one of the basic tasks in natural language processing (NLP), named entity recognition (NER) is an important basic tool for downstream tasks of NLP, such as information extraction, syntactic analysis, machine translation and so on. The internal operation logic of current name entity recognition model is black-box to the user, so the user has no basis to determine which name entity makes more sense. Therefore, a user-friendly explainable recognition process would be very useful for many people. In this paper, we propose a novel interpretable method, BTPK (Binary Talmudic Public Announcement Logic model), to help users understand the internal recognition logic of the name entity recognition tasks based on Talmudic Public Announcement Logic. BTPK model can also capture the semantic information in the input sentences, that is, the context dependency of the sentence. We observed the public announcement of BTPK presents the inner decision logic of BRNNs, and the explanations obtained from a BTPK model show us how BRNNs essentially handle NER tasks.
BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic

Yulin Chen,Zelai Yao,Haixiao Chi,Dov M. Gabbay,Bo Yuan,Bruno Bentzen,Beishui Liao

DOI: https://doi.org/10.48550/arxiv.2201.09523

2022-01-01

Abstract:As one of the basic tasks in natural language processing (NLP), named entity recognition (NER) is an important basic tool for downstream tasks of NLP, such as information extraction, syntactic analysis, machine translation and so on. The internal operation logic of current name entity recognition model is black-box to the user, so the user has no basis to determine which name entity makes more sense. Therefore, a user-friendly explainable recognition process would be very useful for many people. In this paper, we propose a novel interpretable method, BTPK (Binary Talmudic Public Announcement Logic model), to help users understand the internal recognition logic of the name entity recognition tasks based on Talmudic Public Announcement Logic. BTPK model can also capture the semantic information in the input sentences, that is, the context dependency of the sentence. We observed the public announcement of BTPK presents the inner decision logic of BRNNs, and the explanations obtained from a BTPK model show us how BRNNs essentially handle NER tasks.
KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

Yilin Lu,Xiaoqiang Wang,Haofeng Yang,Siliang Tang

DOI: https://doi.org/10.1609/aaai.v37i11.26565

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Machine Learning is often challenged by insufficient labeled data. Previous methods employing implicit commonsense knowledge of pre-trained language models (PLMs) or pattern-based symbolic knowledge have achieved great success in mitigating manual annotation efforts. In this paper, we focus on the collaboration among different knowledge sources and present KICE, a K nowledge-evolving framework by I terative C onsolidation and E xpansion with the guidance of PLMs and rule-based patterns. Specifically, starting with limited labeled data as seeds, KICE first builds a Rule Generator by prompt-tuning to stimulate the rich knowledge distributed in PLMs, generate seed rules, and initialize the rules set. Afterwards, based on the rule-labeled data, the task model is trained in a self-training pipeline where the knowledge in rules set is consolidated with self-learned high-confidence rules. Finally, for the low-confidence rules, KICE solicits human-enlightened understanding and expands the knowledge coverage for better task model training. Our framework is verified on relation extraction (RE) task, and the experiments on TACRED show that the model performance ( F 1 ) grows from 33.24% to 79.84% with the enrichment of knowledge, outperforming all the baselines including other knowledgeable methods.
PRIS at TREC 2012 Contextual Suggestion Track.

Lin Qiu,JunRui Peng,Qianqian Wang,Yue Liu,Zhihua Zhou,Weiran Xu,Guang Chen,Jun Guo

DOI: https://doi.org/10.6028/nist.sp.500-298.context-pris

2012-01-01

Abstract:: The system to Contextual Suggestion Track at TREC2012 includes information crawling and preprocessing, context filtering, user modeling, similarity computing and ranking, description generating. Some third party tool kits are used, such as URLPARSE. TF-IDF (term frequency-inverse document frequency) and cosine similarity is also used for building user models and computed similarities between users and candidate items.
BUPT-MCPRL at TRECVID 2011.

Zhicheng Zhao,Yanyun Zhao,Xin Guo,Yuanbo Chen,Yan Hua,Wen Wang,Cheng Liu,Siyuan Wu,Han Zhang,Lingxi Wang,Yuanhui Mao,Anni Cai,Menghua Zhai

2011-01-01

Abstract:In this paper, we describe BUPT-MCPRL systems for TRECVID 2011. Our team participated in five tasks: semantic indexing, known-item search, instance search content-based copy detection and surveillance event detection. A brief introduction is shown as follows: A. Known-item search In this year, we proposed two different methods: one based on text and another is bio-inspired method. All 2 runs we submitted are described in Table 1. Table 1. KIS results and descriptions for each run
Combining MIML and Distant Supervision for KBP Slot Filling

Jinjian Zhang,Huachun Ma,Siliang Tang,Fei Wu

2015-01-01

Theory and applications of categories

Abstract:This paper describes the DCD slot filling system for the TAC Cold Start evaluations 2015 Task. The ZJU_DCD_SF 2015 slot filling system mainly uses several classical methods to obtain the slot filler. For Named Entity Recognize and coreference, we apply Stanford Core NLP system. For generating training data, we use the distant supervision, which is a very popular way among the slot-filling task. For classification in sentence level, our system uses the Multi Instances Multi Label method, which is pretty suitable for the nature of the training data generated by distant supervision.

PRIS at TAC2012 KBP Track.

ICL KBP Approaches to Knowledge Base Population at TAC2010

Collective Entity Linking and a Simple Slot Filling Method for TAC-KBP 2011.

OpenKN at TAC KBP 2016.

NLPComp in TAC 2012 Entity Linking and Slot-Filling.

THUNLP at TAC KBP 2011 in Entity Linking.

ITNLP Entity Linking System at TAC 2013.

HIT Approaches to Entity Linking at TAC 2012.

HIT Approaches to Entity Linking at TAC 2011.

PKUTM Participation at TAC 2010 RTE and Summarization Track.

CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

Calculating Question Similarity is Enough: A New Method for KBQA Tasks

BTPK-based learning: An Interpretable Method for Named Entity Recognition

Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocols

Programming Knowledge Tracing: A Comprehensive Dataset and A New Model

BTPK-based Interpretable Method for NER Tasks Based on Talmudic Public Announcement Logic

BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic

KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

PRIS at TREC 2012 Contextual Suggestion Track.

BUPT-MCPRL at TRECVID 2011.

Combining MIML and Distant Supervision for KBP Slot Filling