Textomics: A Dataset for Genomics Data Summary Generation

Mu‐Chun Wang,Fei Liu,Sheng Wang

DOI: https://doi.org/10.5281/zenodo.6478173

2022-01-01

Abstract:This is the dataset of our ACL 2022 paper: Textomics: A Dataset for Genomics Data Summary Generation. Please read the "readme.md" in it for the format of the dataset.

What problem does this paper attempt to address?

Textomics: A Dataset for Genomics Data Summary Generation

Mu-Chun Wang,Zixuan Liu,Sheng Wang

DOI: https://doi.org/10.18653/v1/2022.acl-long.335

2022-01-01

Abstract:Summarizing biomedical discovery from genomics data using natural languages is an essential step in biomedical research but is mostly done manually. Here, we introduce Textomics, a novel dataset of genomics data description, which contains 22,273 pairs of genomics data matrices and their summaries. Each summary is written by the researchers who generated the data and associated with a scientific paper. Based on this dataset, we study two novel tasks: generating textual summary from a genomics data matrix and vice versa. Inspired by the successful applications of k nearest neighbors in modeling genomics data, we propose a kNN-Vec2Text model to address these tasks and observe substantial improvement on our dataset. We further illustrate how Textomics can be used to advance other applications, including evaluating scientific paper embeddings and generating masked templates for scientific paper understanding. Textomics serves as the first benchmark for generating textual summaries for genomics data and we envision it will be broadly applied to other biomedical and natural language processing applications.(1)
CLTS+: A New Chinese Long Text Summarization Dataset with Abstractive Summaries

Xiaojun Liu,Shunan Zang,Chuang Zhang,Xiaojun Chen,Yangyang Ding

DOI: https://doi.org/10.48550/arXiv.2206.04253

2022-06-09

Abstract:The abstractive methods lack of creative ability is particularly a problem in automatic text summarization. The summaries generated by models are mostly extracted from the source articles. One of the main causes for this problem is the lack of dataset with abstractiveness, especially for Chinese. In order to solve this problem, we paraphrase the reference summaries in CLTS, the Chinese Long Text Summarization dataset, correct errors of factual inconsistencies, and propose the first Chinese Long Text Summarization dataset with a high level of abstractiveness, CLTS+, which contains more than 180K article-summary pairs and is available online. Additionally, we introduce an intrinsic metric based on co-occurrence words to evaluate the dataset we constructed. We analyze the extraction strategies used in CLTS+ summaries against other datasets to quantify the abstractiveness and difficulty of our new data and train several baselines on CLTS+ to verify the utility of it for improving the creative ability of models.

Computation and Language,Artificial Intelligence
LCSTS: A Large Scale Chinese Short Text Summarization Dataset

Baotian Hu,Qingcai Chen,Fangze Zhu

DOI: https://doi.org/10.48550/arXiv.1506.05865

2016-02-20

Abstract:Automatic text summarization is widely regarded as the highly difficult problem, partially because of the lack of large text summarization data set. Due to the great challenge of constructing the large scale summaries for full text, in this paper, we introduce a large corpus of Chinese short text summarization dataset constructed from the Chinese microblogging website Sina Weibo, which is released to the public {<a class="link-external link-http" href="http://icrc.hitsz.edu.cn/Article/show/139.html" rel="external noopener nofollow">this http URL</a>}. This corpus consists of over 2 million real Chinese short texts with short summaries given by the author of each text. We also manually tagged the relevance of 10,666 short summaries with their corresponding short texts. Based on the corpus, we introduce recurrent neural network for the summary generation and achieve promising results, which not only shows the usefulness of the proposed corpus for short text summarization research, but also provides a baseline for further research on this topic.

Computation and Language,Information Retrieval,Machine Learning
DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures

Xu-Cheng Yin,Chun Yang,Wei-Yi Pei,Haixia Man,Jun Zhang,Erik Learned-Miller,Hong Yu

DOI: https://doi.org/10.1371/journal.pone.0126200

IF: 3.7

2015-05-07

PLoS ONE

Abstract:Hundreds of millions of figures are available in biomedical literature, representing important biomedical experimental evidence. Since text is a rich source of information in figures, automatically extracting such text may assist in the task of mining figure information. A high-quality ground truth standard can greatly facilitate the development of an automated system. This article describes DeTEXT: A database for evaluating text extraction from biomedical literature figures. It is the first publicly available, human-annotated, high quality, and large-scale figure-text dataset with 288 full-text articles, 500 biomedical figures, and 9308 text regions. This article describes how figures were selected from open-access full-text biomedical articles and how annotation guidelines and annotation tools were developed. We also discuss the inter-annotator agreement and the reliability of the annotations. We summarize the statistics of the DeTEXT data and make available evaluation protocols for DeTEXT. Finally we lay out challenges we observed in the automated detection and recognition of figure text and discuss research directions in this area. DeTEXT is publicly available for downloading at http://prir.ustb.edu.cn/DeTEXT/.
CSL: A Large-scale Chinese Scientific Literature Dataset

Yudong Li,Yuqing Zhang,Zhe Zhao,Linlin Shen,Weijie Liu,Weiquan Mao,Hui Zhang

DOI: https://doi.org/10.48550/arXiv.2209.05034

2022-09-12

Computation and Language

Abstract:Scientific literature serves as a high-quality corpus, supporting a lot of Natural Language Processing (NLP) research. However, existing datasets are centered around the English language, which restricts the development of Chinese scientific NLP. In this work, we present CSL, a large-scale Chinese Scientific Literature dataset, which contains the titles, abstracts, keywords and academic fields of 396k papers. To our knowledge, CSL is the first scientific document dataset in Chinese. The CSL can serve as a Chinese corpus. Also, this semi-structured data is a natural annotation that can constitute many supervised NLP tasks. Based on CSL, we present a benchmark to evaluate the performance of models across scientific domain tasks, i.e., summarization, keyword generation and text classification. We analyze the behavior of existing text-to-text models on the evaluation tasks and reveal the challenges for Chinese scientific NLP tasks, which provides a valuable reference for future research. Data and code are available at https://github.com/ydli-ai/CSL
A LARGE-SCALE CHINESE LONG-TEXT EXTRACTIVE SUMMARIZATION CORPUS

Kai Chen,Guanyu Fu,Qingcai Chen,Baotian Hu

DOI: https://doi.org/10.1109/icassp39728.2021.9414946

2021-01-01

Abstract:Recently, large-scale datasets have vastly facilitated the development in nearly domains of Natural Language Processing. However, lacking large scale Chinese corpus is still a critical bottleneck for further research on deep text summarization methods. In this paper, we publish a large-scale Chinese Long-text Extractive Summarization corpus named CLES. The CLES contains about 104K pairs, which is originally collected from Sina Weibo1. To verify the quality of the corpus, we also manually tagged the relevance score of 5,000 pairs. Our benchmark models on the proposed corpus include conventional deep learning based extractive models and several pre-trained Bert-based algorithms. Their performances are reported and briefly analyzed to facilitate further research on the corpus. We will release this corpus for further research(2).
Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction

Zheye Deng,Chunkit Chan,Weiqi Wang,Yuxi Sun,Wei Fan,Tianshi Zheng,Yauwai Yim,Yangqiu Song

2024-04-22

Abstract:The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text summarization and text mining. Previous approaches often generate tables that directly replicate information from the text, limiting their applicability in broader contexts, as text-to-table generation in real-life scenarios necessitates information extraction, reasoning, and integration. However, there is a lack of both datasets and methodologies towards this task. In this paper, we introduce LiveSum, a new benchmark dataset created for generating summary tables of competitions based on real-time commentary texts. We evaluate the performances of state-of-the-art LLMs on this task in both fine-tuning and zero-shot settings, and additionally propose a novel pipeline called $T^3$(Text-Tuple-Table) to improve their performances. Extensive experimental results demonstrate that LLMs still struggle with this task even after fine-tuning, while our approach can offer substantial performance gains without explicit training. Further analyses demonstrate that our method exhibits strong generalization abilities, surpassing previous approaches on several other text-to-table datasets. Our code and data can be found at

Computation and Language
GenoTEX: A Benchmark for Evaluating LLM-Based Exploration of Gene Expression Data in Alignment with Bioinformaticians

Haoyang Liu,Haohan Wang

2024-06-22

Abstract:Recent advancements in machine learning have significantly improved the identification of disease-associated genes from gene expression datasets. However, these processes often require extensive expertise and manual effort, limiting their scalability. Large Language Model (LLM)-based agents have shown promise in automating these tasks due to their increasing problem-solving abilities. To support the evaluation and development of such methods, we introduce GenoTEX, a benchmark dataset for the automatic exploration of gene expression data, involving the tasks of dataset selection, preprocessing, and statistical analysis. GenoTEX provides annotated code and results for solving a wide range of gene identification problems, in a full analysis pipeline that follows the standard of computational genomics. These annotations are curated by human bioinformaticians who carefully analyze the datasets to ensure accuracy and reliability. To provide baselines for these tasks, we present GenoAgents, a team of LLM-based agents designed with context-aware planning, iterative correction, and domain expert consultation to collaboratively explore gene datasets. Our experiments with GenoAgents demonstrate the potential of LLM-based approaches in genomics data analysis, while error analysis highlights the challenges and areas for future improvement. We propose GenoTEX as a promising resource for benchmarking and enhancing AI-driven methods for genomics data analysis. We make our benchmark publicly available at \url{<a class="link-external link-https" href="https://github.com/Liu-Hy/GenoTex" rel="external noopener nofollow">this https URL</a>}.

Machine Learning,Artificial Intelligence,Genomics
CNTLS: A Benchmark Dataset for Abstractive or Extractive Chinese Timeline Summarization

Qianren Mao,Jiazheng Wang,Zheng Wang,Xi Li,Bo Li,Jianxin Li

2023-11-15

Abstract:Timeline summarization (TLS) involves creating summaries of long-running events using dated summaries from numerous news articles. However, limited data availability has significantly slowed down the development of timeline summarization. In this paper, we introduce the CNTLS dataset, a versatile resource for Chinese timeline summarization. CNTLS encompasses 77 real-life topics, each with 2524 documents and summarizes nearly 60\% days duration compression on average all topics. We meticulously analyze the corpus using well-known metrics, focusing on the style of the summaries and the complexity of the summarization task. Specifically, we evaluate the performance of various extractive and generative summarization systems on the CNTLS corpus to provide benchmarks and support further research. To the best of our knowledge, CNTLS is the first Chinese timeline summarization dataset. The dataset and source code are released\footnote{Code and data available at: \emph{\url{<a class="link-external link-https" href="https://github.com/OpenSUM/CNTLS" rel="external noopener nofollow">this https URL</a>}}.}.

Artificial Intelligence,Information Retrieval,Machine Learning
Text mining for contexts and relationships in cancer genomics literature

Charlotte Collins,Simon Baker,Jason Brown,Huiyuan Zheng,Adelyne Chan,Ulla Stenius,Masashi Narita,Anna Korhonen

DOI: https://doi.org/10.1093/bioinformatics/btae021

IF: 5.8

2024-01-01

Bioinformatics

Abstract:Abstract Motivation Scientific advances build on the findings of existing research. The 2001 publication of the human genome has led to the production of huge volumes of literature exploring the context-specific functions and interactions of genes. Technology is needed to perform large-scale text mining of research papers to extract the reported actions of genes in specific experimental contexts and cell states, such as cancer, thereby facilitating the design of new therapeutic strategies. Results We present a new corpus and Text Mining methodology that can accurately identify and extract the most important details of cancer genomics experiments from biomedical texts. We build a Named Entity Recognition model that accurately extracts relevant experiment details from PubMed abstract text, and a second model that identifies the relationships between them. This system outperforms earlier models and enables the analysis of gene function in diverse and dynamically evolving experimental contexts. Availability and implementation Code and data are available here: https://github.com/cambridgeltl/functional-genomics-ie.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text

Qingyun Li,Zhe Chen,Weiyun Wang,Wenhai Wang,Shenglong Ye,Zhenjiang Jin,Guanzhou Chen,Yinan He,Zhangwei Gao,Erfei Cui,Jiashuo Yu,Hao Tian,Jiasheng Zhou,Chao Xu,Bin Wang,Xingjian Wei,Wei Li,Wenjian Zhang,Bo Zhang,Pinlong Cai,Licheng Wen,Xiangchao Yan,Zhenxiang Li,Pei Chu,Yi Wang,Min Dou,Changyao Tian,Xizhou Zhu,Lewei Lu,Yushi Chen,Junjun He,Zhongying Tu,Tong Lu,Yali Wang,Limin Wang,Dahua Lin,Yu Qiao,Botian Shi,Conghui He,Jifeng Dai

2024-07-12

Abstract:Image-text interleaved data, consisting of multiple images and texts arranged in a natural document format, aligns with the presentation paradigm of internet data and closely resembles human reading habits. Recent studies have shown that such data aids multimodal in-context learning and maintains the capabilities of large language models during multimodal fine-tuning. However, the limited scale and diversity of current image-text interleaved data restrict the development of multimodal large language models. In this paper, we introduce OmniCorpus, a 10 billion-scale image-text interleaved dataset. Using an efficient data engine, we filter and extract large-scale high-quality documents, which contain 8.6 billion images and 1,696 billion text tokens. Compared to counterparts (e.g., MMC4, OBELICS), our dataset 1) has 15 times larger scales while maintaining good data quality; 2) features more diverse sources, including both English and non-English websites as well as video-centric websites; 3) is more flexible, easily degradable from an image-text interleaved format to pure text corpus and image-text pairs. Through comprehensive analysis and experiments, we validate the quality, usability, and effectiveness of the proposed dataset. We hope this could provide a solid data foundation for future multimodal model research. Code and data are released at <a class="link-external link-https" href="https://github.com/OpenGVLab/OmniCorpus" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence
Towards Automatic Generation of Gene Summary

Feng Jin,Minlie Huang,Zhiyong Lu,Xiaoyan Zhu

DOI: https://doi.org/10.3115/1572364.1572377

2009-01-01

Abstract:In this paper we present an extractive system that automatically generates gene summaries from the biomedical literature. The proposed text summarization system selects and ranks sentences from multiple MEDLINE abstracts by exploiting gene-specific information and similarity relationships between sentences. We evaluate our system on a large dataset of 7,294 human genes and 187,628 MEDLINE abstracts using Recall-Oriented Understudy for Gisting Evaluation (ROUGE), a widely used automatic evaluation metric in the text summarization community. Two baseline methods are used for comparison. Experimental results show that our system significantly outperforms the other two methods with regard to all ROUGE metrics. A demo website of our system is freely accessible at http://60.195.250.72/onbires/summary.jsp.
A Dataset for Exploring Gaze Behaviors in Text Summarization.

Kun Yi,Yu Guo,Weifeng Jiang,Zhi Wang,Lifeng Sun

DOI: https://doi.org/10.1145/3339825.3394928

2020-01-01

Abstract:Automatic text summarization has been a hot research topic for years. Though most of the existing studies only use the content itself to generate the summaries, researchers believe that an individual's reading behaviors have much to do with the summaries s/he generates, usually regarded as the ground truth. However, such research is limited by the lack of a dataset that provides the connection between people's reading behaviors and the summaries provided by them. This paper fills in this gap by providing a dataset covering 50 individuals' gaze behaviors collected by a high-accurate eye tracking device (that generates 100 gaze points per second) when they are reading 100 articles (from 10 popular categories) and composing the corresponding summaries for each article. Collected in a controlled environment, our dataset with 157 million gaze points in total, provides not only the basic gaze behaviors when different people read an article and compose its corresponding summary, but also the connections between different behavior patterns and the summaries they will provide. We believe such a dataset will be valuable for a wide range of studies, and we also provide sample use cases of the dataset.
MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos

Jielin Qiu,Jiacheng Zhu,William Han,Aditesh Kumar,Karthik Mittal,Claire Jin,Zhengyuan Yang,Linjie Li,Jianfeng Wang,Ding Zhao,Bo Li,Lijuan Wang

2023-11-19

Abstract:Multimodal summarization with multimodal output (MSMO) has emerged as a promising research direction. Nonetheless, numerous limitations exist within existing public MSMO datasets, including insufficient maintenance, data inaccessibility, limited size, and the absence of proper categorization, which pose significant challenges. To address these challenges and provide a comprehensive dataset for this new direction, we have meticulously curated the \textbf{MMSum} dataset. Our new dataset features (1) Human-validated summaries for both video and textual content, providing superior human instruction and labels for multimodal learning. (2) Comprehensively and meticulously arranged categorization, spanning 17 principal categories and 170 subcategories to encapsulate a diverse array of real-world scenarios. (3) Benchmark tests performed on the proposed dataset to assess various tasks and methods, including \textit{video summarization}, \textit{text summarization}, and \textit{multimodal summarization}. To champion accessibility and collaboration, we will release the \textbf{MMSum} dataset and the data collection tool as fully open-source resources, fostering transparency and accelerating future developments. Our project website can be found at~\url{<a class="link-external link-https" href="https://mmsum-dataset.github.io/" rel="external noopener nofollow">this https URL</a>}

Computer Vision and Pattern Recognition,Multimedia
MCTS: A Multi-Reference Chinese Text Simplification Dataset

Ruining Chong,Luming Lu,Liner Yang,Jinran Nie,Zhenghao Liu,Shuo Wang,Shuhan Zhou,Yaoxin Li,Erhong Yang

2024-06-05

Abstract:Text simplification aims to make the text easier to understand by applying rewriting transformations. There has been very little research on Chinese text simplification for a long time. The lack of generic evaluation data is an essential reason for this phenomenon. In this paper, we introduce MCTS, a multi-reference Chinese text simplification dataset. We describe the annotation process of the dataset and provide a detailed analysis. Furthermore, we evaluate the performance of several unsupervised methods and advanced large language models. We additionally provide Chinese text simplification parallel data that can be used for training, acquired by utilizing machine translation and English text simplification. We hope to build a basic understanding of Chinese text simplification through the foundational work and provide references for future research. All of the code and data are released at <a class="link-external link-https" href="https://github.com/blcuicall/mcts/" rel="external noopener nofollow">this https URL</a>.

Computation and Language
ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications

Sotaro Takeshita,Tommaso Green,Ines Reinig,Kai Eckert,Simone Paolo Ponzetto

DOI: https://doi.org/10.48550/arXiv.2403.05303

2024-03-08

Abstract:Extensive efforts in the past have been directed toward the development of summarization datasets. However, a predominant number of these resources have been (semi)-automatically generated, typically through web data crawling, resulting in subpar resources for training and evaluating summarization systems, a quality compromise that is arguably due to the substantial costs associated with generating ground-truth summaries, particularly for diverse languages and specialized domains. To address this issue, we present ACLSum, a novel summarization dataset carefully crafted and evaluated by domain experts. In contrast to previous datasets, ACLSum facilitates multi-aspect summarization of scientific papers, covering challenges, approaches, and outcomes in depth. Through extensive experiments, we evaluate the quality of our resource and the performance of models based on pretrained language models and state-of-the-art large language models (LLMs). Additionally, we explore the effectiveness of extractive versus abstractive summarization within the scholarly domain on the basis of automatically discovered aspects. Our results corroborate previous findings in the general domain and indicate the general superiority of end-to-end aspect-based summarization. Our data is released at <a class="link-external link-https" href="https://github.com/sobamchan/aclsum" rel="external noopener nofollow">this https URL</a>.

Computation and Language
DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models

Renqiu Xia,Song Mao,Xiangchao Yan,Hongbin Zhou,Bo Zhang,Haoyang Peng,Jiahao Pi,Daocheng Fu,Wenjie Wu,Hancheng Ye,Shiyang Feng,Bin Wang,Chao Xu,Conghui He,Pinlong Cai,Min Dou,Botian Shi,Sheng Zhou,Yongwei Wang,Bin Wang,Junchi Yan,Fei Wu,Yu Qiao

2024-09-11

Abstract:Scientific documents record research findings and valuable human knowledge, comprising a vast corpus of high-quality data. Leveraging multi-modality data extracted from these documents and assessing large models' abilities to handle scientific document-oriented tasks is therefore meaningful. Despite promising advancements, large models still perform poorly on multi-page scientific document extraction and understanding tasks, and their capacity to process within-document data formats such as charts and equations remains under-explored. To address these issues, we present DocGenome, a structured document benchmark constructed by annotating 500K scientific documents from 153 disciplines in the arXiv open-access community, using our custom auto-labeling pipeline. DocGenome features four key characteristics: 1) Completeness: It is the first dataset to structure data from all modalities including 13 layout attributes along with their LaTeX source codes. 2) Logicality: It provides 6 logical relationships between different entities within each scientific document. 3) Diversity: It covers various document-oriented tasks, including document classification, visual grounding, document layout detection, document transformation, open-ended single-page QA and multi-page QA. 4) Correctness: It undergoes rigorous quality control checks conducted by a specialized team. We conduct extensive experiments to demonstrate the advantages of DocGenome and objectively evaluate the performance of large models on our benchmark.

Computer Vision and Pattern Recognition
15M Multimodal Facial Image-Text Dataset

Dawei Dai,YuTang Li,YingGe Liu,Mingming Jia,Zhang YuanHui,Guoyin Wang

2024-07-12

Abstract:Currently, image-text-driven multi-modal deep learning models have demonstrated their outstanding potential in many fields. In practice, tasks centered around facial images have broad application prospects. This paper presents \textbf{FaceCaption-15M}, a large-scale, diverse, and high-quality dataset of facial images accompanied by their natural language descriptions (facial image-to-text). This dataset aims to facilitate a study on face-centered tasks. FaceCaption-15M comprises over 15 million pairs of facial images and their corresponding natural language descriptions of facial features, making it the largest facial image-caption dataset to date. We conducted a comprehensive analysis of image quality, text naturalness, text complexity, and text-image relevance to demonstrate the superiority of FaceCaption-15M. To validate the effectiveness of FaceCaption-15M, we first trained a facial language-image pre-training model (FLIP, similar to CLIP) to align facial image with its corresponding captions in feature space. Subsequently, using both image and text encoders and fine-tuning only the linear layer, our FLIP-based models achieved state-of-the-art results on two challenging face-centered tasks. The purpose is to promote research in the field of face-related tasks through the availability of the proposed FaceCaption-15M dataset. All data, codes, and models are publicly available. <a class="link-external link-https" href="https://huggingface.co/datasets/OpenFace-CQUPT/FaceCaption-15M" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Artificial Intelligence
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation.

Junwei Yang,Zequn Liu,Ming Zhang,Sheng Wang

DOI: https://doi.org/10.18653/v1/2022.findings-naacl.108

2022-01-01

Abstract:Biomedical pathways have been extensively used to characterize the mechanism of complex diseases. One essential step in biomedical pathway analysis is to curate the description of a pathway based on its graph structure and node features. Neural text generation could be a plausible technique to circumvent the tedious manual curation. In this paper, we propose a new dataset Pathway2Text, which contains 2,367 pairs of biomedical pathways and textual descriptions. All pathway graphs are experimentally derived or manually curated. All textual descriptions are written by domain experts. We form this problem as a Graph2Text task and propose a novel graph-based text generation approach kNN-Graph2Text, which explicitly exploited descriptions of similar graphs to generate new descriptions. We observed substantial improvement of our method on both Graph2Text and the reverse task of Text2Graph. We further illustrated how our dataset can be used as a novel benchmark for biomedical named entity recognition. Collectively, we envision our method will become an important benchmark for evaluating Graph2Text methods and advance biomedical research for complex diseases.
Extractive Summarization As Text Matching

Ming Zhong,Pengfei Liu,Yiran Chen,Danqing Wang,Xipeng Qiu,Xuanjing Huang

DOI: https://doi.org/10.18653/v1/2020.acl-main.552

2020-01-01

Abstract:This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between sentences, we formulate the extractive summarization task as a semantic text matching problem, in which a source document and candidate summaries will be (extracted from the original text) matched in a semantic space. Notably, this paradigm shift to semantic matching framework is well-grounded in our comprehensive analysis of the inherent gap between sentence-level and summary-level extractors based on the property of the dataset. Besides, even instantiating the framework with a simple form of a matching model, we have driven the state-of-the-art extractive result on CNN/DailyMail to a new level (44.41 in ROUGE-1). Experiments on the other five datasets also show the effectiveness of the matching framework. We believe the power of this matching-based summarization framework has not been fully exploited. To encourage more instantiations in the future, we have released our codes, processed dataset, as well as generated summaries in https://github.com/maszhongming/MatchSum.

Textomics: A Dataset for Genomics Data Summary Generation

Textomics: A Dataset for Genomics Data Summary Generation

CLTS+: A New Chinese Long Text Summarization Dataset with Abstractive Summaries

LCSTS: A Large Scale Chinese Short Text Summarization Dataset

DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures

CSL: A Large-scale Chinese Scientific Literature Dataset

A LARGE-SCALE CHINESE LONG-TEXT EXTRACTIVE SUMMARIZATION CORPUS

Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction

GenoTEX: A Benchmark for Evaluating LLM-Based Exploration of Gene Expression Data in Alignment with Bioinformaticians

CNTLS: A Benchmark Dataset for Abstractive or Extractive Chinese Timeline Summarization

Text mining for contexts and relationships in cancer genomics literature

OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text

Towards Automatic Generation of Gene Summary

A Dataset for Exploring Gaze Behaviors in Text Summarization.

MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos

MCTS: A Multi-Reference Chinese Text Simplification Dataset

ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications

DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models

15M Multimodal Facial Image-Text Dataset

Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation.

Extractive Summarization As Text Matching