Abstract:Script event prediction aims to predict the subsequent event given the context. This requires the capability to infer the correlations between events. Recent works have attempted to improve event correlation reasoning by using pretrained language models and incorporating external knowledge~(e.g., discourse relations). Though promising results have been achieved, some challenges still remain. First, the pretrained language models adopted by current works ignore event-level knowledge, resulting in an inability to capture the correlations between events well. Second, modeling correlations between events with discourse relations is limited because it can only capture explicit correlations between events with discourse markers, and cannot capture many implicit correlations. To this end, we propose a novel generative approach for this task, in which a pretrained language model is fine-tuned with an event-centric pretraining objective and predicts the next event within a generative paradigm. Specifically, we first introduce a novel event-level blank infilling strategy as the learning objective to inject event-level knowledge into the pretrained language model, and then design a likelihood-based contrastive loss for fine-tuning the generative model. Instead of using an additional prediction layer, we perform prediction by using sequence likelihoods generated by the generative model. Our approach models correlations between events in a soft way without any external knowledge. The likelihood-based prediction eliminates the need to use additional networks to make predictions and is somewhat interpretable since it scores each word in the event. Experimental results on the multi-choice narrative cloze~(MCNC) task demonstrate that our approach achieves better results than other state-of-the-art baselines. Our code will be available at <a class="link-external link-https" href="https://github.com/zhufq00/mcnc" rel="external noopener nofollow">this https URL</a>.

Event Extraction With Dynamic Prefix Tuning and Relevance Retrieval

Dynamic Prefix-Tuning for Generative Template-based Event Extraction

Contextualized Hybrid Prompt-Tuning for Generation-Based Event Extraction.

Prompt for extraction: Multiple templates choice model for event extraction

DEGAP: Dual Event-Guided Adaptive Prefixes for Templated-Based Event Argument Extraction with Slot Querying

Learning to Ask for Data-Efficient Event Argument Extraction

KeyEE: Enhancing Low-Resource Generative Event Extraction with Auxiliary Keyword Sub-Prompt

DEGREE: A Data-Efficient Generation-Based Event Extraction Model

Event GDR: Event-Centric Generative Document Retrieval

EADRE: Event-type Aware Dynamic Representation of Entities in Document-level Event Extraction

Syntax-based dynamic latent graph for event relation extraction

Event-enhanced Retrieval in Real-time Search

Enhancing Document-level Event Argument Extraction with Contextual Clues and Role Relevance.

GraphERE: Jointly Multiple Event-Event Relation Extraction via Graph-Enhanced Event Embeddings

OneEE: A One-Stage Framework for Fast Overlapping and Nested Event Extraction

Event extraction as machine reading comprehension with question-context bridging

Revisiting Event Argument Extraction: Can EAE Models Learn Better When Being Aware of Event Co-occurrences?

Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding

Efficient Document-level Event Extraction via Pseudo-Trigger-aware Pruned Complete Graph

A Generative Approach for Script Event Prediction via Contrastive Fine-tuning

A graph propagation model with rich event structures for joint event relation extraction