Abstract:Multi-Document Summarization (MDS) aims to generate a concise summary for a collection of documents on the same topic. However, the fixed input length and a large number of redundancies in source documents make the pre-trained models less effective in MDS. In this paper, we propose a two-stage abstractive MDS model based on Predicate-Argument Structure (PAS). In the first stage, we divide the redundancy of documents into intra-sentence redundancy and intersentence redundancy. For intra-sentence redundancy, our model utilizes Semantic Role Labeling (SRL) to covert each sentence to a PAS. Benefiting from PAS, we can filter out redundant contents while preserving the salient information. For inter-sentence redundancy, we introduce a novel similarity calculation method that incorporates semantic and syntactic knowledge to identify and remove duplicate information. The above two steps significantly shorten the input length and eliminate documents redundancies, which is crucial for MDS. In the second stage, we sort the filtered PASs to ensure important contents appear at the beginning and concatenate them into a new document. We employ a pre-trained model ProphetNet to generate an abstractive summary from the new document. Our model combines the advantages of ProphetNet and PAS on global information to generate comprehensive summaries. We conduct extensive experiments on three standard MDS datasets. All experiments demonstrate that our model outperforms the abstractive MDS baselines measured by ROUGE scores. Furthermore, the first stage of our model can improve the performance of other pre-trained models in abstractive MDS.

Abstractive Automatic Summarizing Model for Legal Judgment Documents

Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation

Low-Resource Court Judgment Summarization for Common Law Systems

Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarization

Modeling Endorsement for Multi-Document Abstractive Summarization

Legal Extractive Summarization of U.S. Court Opinions

An Efficient Approach to Learning Chinese Judgment Document Similarity Based on Knowledge Summarization

How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization?

Abstractive Document Summarization via Neural Model with Joint Attention

Computing and Exploiting Document Structure to Improve Unsupervised Extractive Summarization of Legal Case Decisions

Improving Abstractive Multi-document Summarization with Predicate-Argument Structure Extraction.

Analyzing Sentence Fusion in Abstractive Summarization

Large text document summarization based on an enhanced fuzzy logic approach

Legal Summarization for Multi-role Debate Dialogue via Controversy Focus Mining and Multi-task Learning

Abstractive Multi-Document Summarization Via Joint Learning with Single-Document Summarization.

Summarizing long regulatory documents with a multi-step pipeline

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss

LLM Based Multi-Document Summarization Exploiting Main-Event Biased Monotone Submodular Content Extraction

Controllable Multi-document Summarization: Coverage & Coherence Intuitive Policy with Large Language Model Based Rewards