Status Quo and Development on Large Scale Text Retrieval

Guo Yikun,Wu Lide,Huang Xuanjing

1999-01-01

Abstract:IA comprehensive summarization or the recent research works on large scale text retrieval is presented in this paper. It also investigates the further research direction in this field.

What problem does this paper attempt to address?

Implementation of large-scale distributed information retrieval system

Liang Sun,Gen Cai Chen

DOI: https://doi.org/10.1109/ICII.2001.983029

2001-01-01

Abstract:Parallel and distributed IR holds great potential for tackling the performance and scale issues associated with the large and growing document collections currently available online. We surveyed a number of techniques for exploiting modern parallel architectures. We can easily implement a parallel system that works on both multiprocessor and distributed architectures with relatively little modification. We also present some challenges on parallel and distributed IR, and the future work for tackling these issues
From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information

Shen Gao,Xiuying Chen,Zhaochun Ren,Dongyan Zhao,Rui Yan

DOI: https://doi.org/10.24963/ijcai.2020/676

2020-01-01

Abstract:Text summarization is the research area aiming at creating a short and condensed version of the original document, which conveys the main idea of the document in a few words. This research topic has started to attract the attention of a large community of researchers, and it is nowadays counted as one of the most promising research areas. In general, text summarization algorithms aim at using a plain text document as input and then output a summary. However, in real-world applications, most of the data is not in a plain text format. Instead, there is much manifold information to be summarized, such as the summary for a web page based on a query in the search engine, extreme long document (e.g. academic paper), dialog history and so on. In this paper, we focus on the survey of these new summarization tasks and approaches in the real-world application.
Survey of Query-based Text Summarization

Hang Yu,Jiawei Han

2024-10-07

Abstract:Query-based text summarization is an important real world problem that requires to condense the prolix text data into a summary under the guidance of the query information provided by users. The topic has been studied for a long time and there are many existing interesting research related to query-based text summarization. Yet much of the work is not systematically surveyed. This survey aims at summarizing some interesting work in query-based text summarization methods as well as related generic text summarization methods. Not all taxonomies in this paper exist the related work to the best of our knowledge and some analysis will be presented.

Information Retrieval,Computation and Language
LCSTS: A Large Scale Chinese Short Text Summarization Dataset

Baotian Hu,Qingcai Chen,Fangze Zhu

DOI: https://doi.org/10.48550/arXiv.1506.05865

2016-02-20

Abstract:Automatic text summarization is widely regarded as the highly difficult problem, partially because of the lack of large text summarization data set. Due to the great challenge of constructing the large scale summaries for full text, in this paper, we introduce a large corpus of Chinese short text summarization dataset constructed from the Chinese microblogging website Sina Weibo, which is released to the public {<a class="link-external link-http" href="http://icrc.hitsz.edu.cn/Article/show/139.html" rel="external noopener nofollow">this http URL</a>}. This corpus consists of over 2 million real Chinese short texts with short summaries given by the author of each text. We also manually tagged the relevance of 10,666 short summaries with their corresponding short texts. Based on the corpus, we introduce recurrent neural network for the summary generation and achieve promising results, which not only shows the usefulness of the proposed corpus for short text summarization research, but also provides a baseline for further research on this topic.

Computation and Language,Information Retrieval,Machine Learning
IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

Jie Cao,Dian Jiao,Qiang Yan,Wenqiao Zhang,Siliang Tang,Yueting Zhuang

2024-07-15

Abstract:Query-focused summarization (QFS) aims to produce summaries that answer particular questions of interest, enabling greater user control and personalization. With the advent of large language models (LLMs), shows their impressive capability of textual understanding through large-scale pretraining, which implies the great potential of extractive snippet generation. In this paper, we systematically investigated two indispensable characteristics that the LLMs-based QFS models should be harnessed, Lengthy Document Summarization and Efficiently Fine-grained Query-LLM Alignment, respectively. Correspondingly, we propose two modules called Query-aware HyperExpert and Query-focused Infini-attention to access the aforementioned characteristics. These innovations pave the way for broader application and accessibility in the field of QFS technology. Extensive experiments conducted on existing QFS benchmarks indicate the effectiveness and generalizability of the proposed approach. Our code is publicly available at <a class="link-external link-https" href="https://github.com/DCDmllm/IDEAL_Summary" rel="external noopener nofollow">this https URL</a>.

Artificial Intelligence,Computation and Language
Recent Advances in Document Summarization

Jin-ge Yao,Xiaojun Wan,Jianguo Xiao

DOI: https://doi.org/10.1007/s10115-017-1042-4

IF: 2.7

2017-01-01

Knowledge and Information Systems

Abstract:The task of automatic document summarization aims at generating short summaries for originally long documents. A good summary should cover the most important information of the original document or a cluster of documents, while being coherent, non-redundant and grammatically readable. Numerous approaches for automatic summarization have been developed to date. In this paper we give a self-contained, broad overview of recent progress made for document summarization within the last 5 years. Specifically, we emphasize on significant contributions made in recent years that represent the state-of-the-art of document summarization, including progress on modern sentence extraction approaches that improve concept coverage, information diversity and content coherence, as well as attempts from summarization frameworks that integrate sentence compression, and more abstractive systems that are able to produce completely new sentences. In addition, we review progress made for document summarization in domains, genres and applications that are different from traditional settings. We also point out some of the latest trends and highlight a few possible future directions.
A Survey on Cross-Lingual Summarization

Jiaan Wang,Fandong Meng,Duo Zheng,Yunlong Liang,Zhixu Li,Jianfeng Qu,Jie Zhou

DOI: https://doi.org/10.48550/arXiv.2203.12515

2022-08-30

Abstract:Cross-lingual summarization is the task of generating a summary in one language (e.g., English) for the given document(s) in a different language (e.g., Chinese). Under the globalization background, this task has attracted increasing attention of the computational linguistics community. Nevertheless, there still remains a lack of comprehensive review for this task. Therefore, we present the first systematic critical review on the datasets, approaches, and challenges in this field. Specifically, we carefully organize existing datasets and approaches according to different construction methods and solution paradigms, respectively. For each type of datasets or approaches, we thoroughly introduce and summarize previous efforts and further compare them with each other to provide deeper analyses. In the end, we also discuss promising directions and offer our thoughts to facilitate future research. This survey is for both beginners and experts in cross-lingual summarization, and we hope it will serve as a starting point as well as a source of new ideas for researchers and engineers interested in this area.

Computation and Language,Artificial Intelligence
UnifieR: A Unified Retriever for Large-Scale Retrieval

Tao Shen,Xiubo Geng,Chongyang Tao,Can Xu,Guodong Long,Kai Zhang,Daxin Jiang

2023-06-04

Abstract:Large-scale retrieval is to recall relevant documents from a huge collection given a query. It relies on representation learning to embed documents and queries into a common semantic encoding space. According to the encoding space, recent retrieval methods based on pre-trained language models (PLM) can be coarsely categorized into either dense-vector or lexicon-based paradigms. These two paradigms unveil the PLMs' representation capability in different granularities, i.e., global sequence-level compression and local word-level contexts, respectively. Inspired by their complementary global-local contextualization and distinct representing views, we propose a new learning framework, UnifieR which unifies dense-vector and lexicon-based retrieval in one model with a dual-representing capability. Experiments on passage retrieval benchmarks verify its effectiveness in both paradigms. A uni-retrieval scheme is further presented with even better retrieval quality. We lastly evaluate the model on BEIR benchmark to verify its transferability.

Information Retrieval,Computation and Language
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

Haopeng Zhang,Philip S. Yu,Jiawei Zhang

2024-06-17

Abstract:Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive review of the research progress and evolution in text summarization through the lens of these paradigm shifts. It is organized into two main parts: (1) a detailed overview of datasets, evaluation metrics, and summarization methods before the LLM era, encompassing traditional statistical methods, deep learning approaches, and PLM fine-tuning techniques, and (2) the first detailed examination of recent advancements in benchmarking, modeling, and evaluating summarization in the LLM era. By synthesizing existing literature and presenting a cohesive overview, this survey also discusses research trends, open challenges, and proposes promising research directions in summarization, aiming to guide researchers through the evolving landscape of summarization research.

Computation and Language
A Review of Advanced Topics in Information Retrieval

Qu Peng,Li Lu,Zhang Lili

2008-01-01

Abstract:The paper introduces some advanced topics and their up-to-date developments, including natural language retrieval, cross-language information retrieval (CLIR), intelligent information retrieval, semantic-based information retrieval and evaluation. Language, intelligence and semantic are closely related and together lead the development of IR. Research on system evaluation also leads the direction of IR development and becomes more accurate. The paper at last discusses the essential relations of these problems in IR and further developing directions.
Research and Implementation of a Full-text Retrieval System

Tianfeng Hou,Yaxiang Lu

DOI: https://doi.org/10.3969/j.issn.1007-757X.2017.05.016

2017-01-01

Abstract:The rapid development of network technology has led to the rapid expansion of the number of electronic documents,how to quickly and accurately obtain the required content from a large number of documents has become a hot topic of current research.Based on MVC model and Lucene architecture,this system has been designed and implemented with a more advanced full-text retrieval performance.System extends the type of document retrieval support,improves the display and access method of the retrieval results,and improves the convenience and performance of the retrieval system.
Beyond Relevant Documents: A Knowledge-Intensive Approach for Query-Focused Summarization using Large Language Models

Weijia Zhang,Jia-Hong Huang,Svitlana Vakulenko,Yumo Xu,Thilina Rajapakse,Evangelos Kanoulas

2024-08-20

Abstract:Query-focused summarization (QFS) is a fundamental task in natural language processing with broad applications, including search engines and report generation. However, traditional approaches assume the availability of relevant documents, which may not always hold in practical scenarios, especially in highly specialized topics. To address this limitation, we propose a novel knowledge-intensive approach that reframes QFS as a knowledge-intensive task setup. This approach comprises two main components: a retrieval module and a summarization controller. The retrieval module efficiently retrieves potentially relevant documents from a large-scale knowledge corpus based on the given textual query, eliminating the dependence on pre-existing document sets. The summarization controller seamlessly integrates a powerful large language model (LLM)-based summarizer with a carefully tailored prompt, ensuring the generated summary is comprehensive and relevant to the query. To assess the effectiveness of our approach, we create a new dataset, along with human-annotated relevance labels, to facilitate comprehensive evaluation covering both retrieval and summarization performance. Extensive experiments demonstrate the superior performance of our approach, particularly its ability to generate accurate summaries without relying on the availability of relevant documents initially. This underscores our method's versatility and practical applicability across diverse query scenarios.

Computation and Language,Information Retrieval
A Comprehensive Survey of Abstractive Text Summarization Based on Deep Learning

Mengli Zhang,Gang Zhou,Wanting Yu,Ningbo Huang,Wenfen Liu

DOI: https://doi.org/10.1155/2022/7132226

IF: 3.12

2022-08-03

Computational Intelligence and Neuroscience

Abstract:With the rapid development of the Internet, the massive amount of web textual data has grown exponentially, which has brought considerable challenges to downstream tasks, such as document management, text classification, and information retrieval. Automatic text summarization (ATS) is becoming an extremely important means to solve this problem. The core of ATS is to mine the gist of the original text and automatically generate a concise and readable summary. Recently, to better balance and develop these two aspects, deep learning (DL)-based abstractive summarization models have been developed. At present, for ATS tasks, almost all state-of-the-art (SOTA) models are based on DL architecture. However, a comprehensive literature survey is still lacking in the field of DL-based abstractive text summarization. To fill this gap, this paper provides researchers with a comprehensive survey of DL-based abstractive summarization. We first give an overview of abstractive summarization and DL. Then, we summarize several typical frameworks of abstractive summarization. After that, we also give a comparison of several popular datasets that are commonly used for training, validation, and testing. We further analyze the performance of several typical abstractive summarization systems on common datasets. Finally, we highlight some open challenges in the abstractive summarization task and outline some future research trends. We hope that these explorations will provide researchers with new insights into DL-based abstractive summarization.

mathematical & computational biology,neurosciences
Query-oriented unsupervised multi-document summarization via deep learning model

Sheng-hua Zhong,Yang Liu,Bin Li,Jing Long

DOI: https://doi.org/10.1016/j.eswa.2015.05.034

IF: 8.5

2015-01-01

Expert Systems with Applications

Abstract:Capturing the compositional process from words to documents is a key challenge in natural language processing and information retrieval: Extractive style query-oriented multi-document summarization generates a summary by extracting a proper set of sentences from multiple documents based on pre-given query. This paper proposes a novel document summarization framework based on deep learning model, which has been shown outstanding extraction ability in many real-world applications. The framework consists of three parts: concepts extraction, summary generation, and reconstruction validation. A new query-oriented extraction technique is proposed to extract information distributed in multiple documents. Then, the whole deep architecture is fine-tuned by minimizing the information loss in reconstruction validation. According to the concepts extracted from deep architecture layer by layer, dynamic programming is used to seek most informative set of sentences for the summary. Experiment on three benchmark datasets (DUC 2005, 2006, and 2007) assess and confirm the effectiveness of the proposed framework and algorithms. Experiment results show that the proposed method outperforms state-of-the-art extractive summarization approaches. Moreover, we also provide the statistical analysis of query words based on Amazon's Mechanical Turk (MTurk) crowdsourcing platform. There exists underlying relationships from topic words to the content which can contribute to summarization task. (C) 2015 Elsevier Ltd. All rights reserved.
LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu,Song Wang,Yang Liu,Shuohang Wang,Yichong Xu,Dan Iter,Chenguang Zhu,Michael Zeng

2023-05-22

Abstract:Query-focused summarization (QFS) aims to extract or generate a summary of an input document that directly answers or is relevant to a given query. The lack of large-scale datasets in the form of documents, queries, and summaries has hindered model development in this area. In contrast, multiple large-scale high-quality datasets for generic summarization exist. We hypothesize that there is a hidden query for each summary sentence in a generic summarization annotation, and we utilize a large-scale pretrained language model to recover it. In this way, we convert four generic summarization benchmarks into a new QFS benchmark dataset, LMGQS, which consists of over 1 million document-query-summary samples. We thoroughly investigate the properties of our proposed dataset and establish baselines with state-of-the-art summarization models. By fine-tuning a language model on LMGQS, we achieve state-of-the-art zero-shot and supervised performance on multiple existing QFS benchmarks, demonstrating the high quality and diversity of LMGQS.

Computation and Language
Overview of Research on Tag Semantic Retrieval in Social Tagging System

Xuan Yungan,Zhu Qinghua,Ju Xiufang

DOI: https://doi.org/10.3969/j.issn.1008-0821.2011.02.049

2011-01-01

Abstract:Resources management and sharing becomes more and more difficult due to semantic ambiguity and not standardized form of tag in Social tagging system.For the purpose of positioning accurate tag semantics,this paper reviews the literature on tag semantic retrieval from two aspects:the extension tag semantic and the emerging tag semantic.The research trend and its shortcomings are investigated.It is realized that the ability of obtain intelligent tag semantic relations with high calculability,strong maneuverability is the future research on semantic retrieval in social tagging system.
Automatic Text Summarization Methods: A Comprehensive Review

Divakar Yadav,Jalpa Desai,Arun Kumar Yadav

DOI: https://doi.org/10.48550/arXiv.2204.01849

2022-03-03

Abstract:One of the most pressing issues that have arisen due to the rapid growth of the Internet is known as information overloading. Simplifying the relevant information in the form of a summary will assist many people because the material on any topic is plentiful on the Internet. Manually summarising massive amounts of text is quite challenging for humans. So, it has increased the need for more complex and powerful summarizers. Researchers have been trying to improve approaches for creating summaries since the 1950s, such that the machine-generated summary matches the human-created summary. This study provides a detailed state-of-the-art analysis of text summarization concepts such as summarization approaches, techniques used, standard datasets, evaluation metrics and future scopes for research. The most commonly accepted approaches are extractive and abstractive, studied in detail in this work. Evaluating the summary and increasing the development of reusable resources and infrastructure aids in comparing and replicating findings, adding competition to improve the outcomes. Different evaluation methods of generated summaries are also discussed in this study. Finally, at the end of this study, several challenges and research opportunities related to text summarization research are mentioned that may be useful for potential researchers working in this area.

Computation and Language,Information Retrieval,Machine Learning
Abstractive summarization: An overview of the state of the art

Som Gupta,S. K Gupta

DOI: https://doi.org/10.1016/j.eswa.2018.12.011

IF: 8.5

2019-05-01

Expert Systems with Applications

Abstract:Summarization, is to reduce the size of the document while preserving the meaning, is one of the most researched areas among the Natural Language Processing (NLP) community. Summarization techniques, on the basis of whether the exact sentences are considered as they appear in the original text or new sentences are generated using natural language processing techniques, are categorized into extractive and abstractive techniques. Extractive summarization has been a very extensively researched topic and has reached to its maturity stage. Now the research has shifted towards the abstractive summarization. The complexities underlying with the natural language text makes abstractive summarization a difficult and a challenging task. This paper presents a comprehensive review of the various works performed in abstractive summarization field. For this purpose, we have selected the recent papers on this topic from Elsevier, ACM, IEEE, Springer, ACL Anthology, Cornell University Library and Google Scholar. The papers are categorized according to the type of abstractive technique used. The paper lists down the various challenges and discusses the future direction for research in this field. Along with these, we have identified the advantages and disadvantages of various methods used for abstractive summarization. We have also listed down the various tools which have been used or developed by researchers for abstractive summarization. The paper also discusses the evaluation techniques being used for assessing the abstractive summaries.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Revisiting Information Retrieval and Deep Learning Approaches for Code Summarization.

Tingwei Zhu,Zhong Li,Minxue Pan,Chaoxuan Shi,Tian Zhang,Yu Pei,Xuandong Li

DOI: https://doi.org/10.1145/3631975

IF: 3.685

2023-01-01

ACM Transactions on Software Engineering and Methodology

Abstract:Code summarization aims to generate short functional descriptions for source code to facilitate code comprehension. While Information Retrieval (IR) approaches that leverage similar code snippets and corresponding summaries have led the early research, Deep Learning (DL) approaches that use neural models to capture statistical properties between code and summaries are now mainstream. Although some preliminary studies suggest that IR approaches are more effective in some cases, it is currently unclear how effective the existing approaches can be in general, where and why IR/DL approaches perform better, and whether the integration of IR and DL can achieve better performance. Consequently, there is an urgent need for a comprehensive study of the IR and DL code summarization approaches to provide guidance for future development in this area. This article presents the first large-scale empirical study of 18 IR, DL, and hybrid code summarization approaches on five benchmark datasets. We extensively compare different types of approaches using automatic metrics, we conduct quantitative and qualitative analyses of where and why IR and DL approaches perform better, respectively, and we also study hybrid approaches for assessing the effectiveness of integrating IR and DL. The study shows that the performance of IR approaches should not be underestimated, that while DL models perform better in predicting tokens from method signatures and capturing structural similarities in code, simple IR approaches tend to perform better in the presence of code with high similarity or long reference summaries, and that existing hybrid approaches do not perform as well as individual approaches in their respective areas of strength. Based on our findings, we discuss future research directions for better code summarization.
A study of extractive summarization of long documents incorporating local topic and hierarchical information

Ting Wang,Chuan Yang,Maoyang Zou,Jiaying Liang,Dong Xiang,Wenjie Yang,Hongyang Wang,Jia Li

DOI: https://doi.org/10.1038/s41598-024-60779-z

IF: 4.6

2024-05-04

Scientific Reports

Abstract:In recent years, the transformer-based language models have achieved remarkable success in the field of extractive text summarization. However, there are still some limitations in this kind of research. First, the transformer language model usually regards the text as a linear sequence, ignoring the inherent hierarchical structure information of the text. Second, for long text data, traditional extractive models often focus on global topic information, which poses challenges in how they capturing and integrating local contextual information within topic segments. To address these issues, we propose a long text extractive summarization model that employs a local topic information extraction module and a text hierarchical extraction module to capture the local topic information and document's hierarchical structure information of the original text. Our approach enhances the ability to determine whether a sentence belongs to the summary. In this experiment, ROUGE score is used as the experimental evaluation index, and evaluates the model on three large public datasets. Through experimental validation, the model demonstrates superior performance in terms of ROUGE-1, ROUGE-2, and ROUGE-L scores compared to current mainstream summarization models, affirming the effectiveness of incorporating local topic information and document hierarchical structure into the model.

multidisciplinary sciences

Status Quo and Development on Large Scale Text Retrieval

Implementation of large-scale distributed information retrieval system

From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information

Survey of Query-based Text Summarization

LCSTS: A Large Scale Chinese Short Text Summarization Dataset

IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

Recent Advances in Document Summarization

A Survey on Cross-Lingual Summarization

UnifieR: A Unified Retriever for Large-Scale Retrieval

A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

A Review of Advanced Topics in Information Retrieval

Research and Implementation of a Full-text Retrieval System

Beyond Relevant Documents: A Knowledge-Intensive Approach for Query-Focused Summarization using Large Language Models

A Comprehensive Survey of Abstractive Text Summarization Based on Deep Learning

Query-oriented unsupervised multi-document summarization via deep learning model

LMGQS: A Large-scale Dataset for Query-focused Summarization

Overview of Research on Tag Semantic Retrieval in Social Tagging System

Automatic Text Summarization Methods: A Comprehensive Review

Abstractive summarization: An overview of the state of the art

Revisiting Information Retrieval and Deep Learning Approaches for Code Summarization.

A study of extractive summarization of long documents incorporating local topic and hierarchical information