Abstract:Video causal reasoning aims to achieve a high-level understanding of video content from a causal perspective. However, current video reasoning tasks are limited in scope, primarily executed in a question-answering paradigm and focusing on short videos containing only a single event and simple causal relationships, lacking comprehensive and structured causality analysis for videos with multiple events. To fill this gap, we introduce a new task and dataset, Multi-Event Causal Discovery (MECD). It aims to uncover the causal relationships between events distributed chronologically across long videos. Given visual segments and textual descriptions of events, MECD requires identifying the causal associations between these events to derive a comprehensive, structured event-level video causal diagram explaining why and how the final result event occurred. To address MECD, we devise a novel framework inspired by the Granger Causality method, using an efficient mask-based event prediction model to perform an Event Granger Test, which estimates causality by comparing the predicted result event when premise events are masked versus unmasked. Furthermore, we integrate causal inference techniques such as front-door adjustment and counterfactual inference to address challenges in MECD like causality confounding and illusory causality. Experiments validate the effectiveness of our framework in providing causal relationships in multi-event videos, outperforming GPT-4o and VideoLLaVA by 5.7% and 4.1%, respectively.

Separate and Integrate Different Level Reasoning for Event Causality Identification

Discriminative Reasoning with Sparse Event Representation for Document-level Event-Event Relation Extraction

Enhancing Event Causality Identification with Rationale and Structure-Aware Causal Question Answering

CHEER: Centrality-aware High-order Event Reasoning Network for Document-level Event Causality Identification

ERGO: Event Relational Graph Transformer for Document-level Event Causality Identification

A Survey of Event Causality Identification: Principles, Taxonomy, Challenges, and Assessment

Advancing Event Causality Identification via Heuristic Semantic Dependency Inquiry Network

Document-level event causality identification via graph inference mechanism

Event Causality Extraction with Event Argument Correlations

Identifying while Learning for Document Event Causality Identification

Event Causality Is Key to Computational Story Understanding

Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering

Event Causality Extraction Based on Connectives Analysis

Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement

Semantic Structure Enhanced Event Causality Identification

Explicit and implicit knowledge-enhanced model for event causality identification

Vacuum formation behind the expansion wave in a piston motion problem.

MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning

SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extraction

Dual Graph Convolutional Networks for Document-Level Event Causality Identification.