Image Enchanced Event Detection in News Articles. Meihan Tong, Shuai Wang

Meihan Tong,Shuai Wang,Yixin Cao,Bin Xu,Juanzi Li,Lei Hou,Tat-Seng Chua

2020-01-01

Abstract:Skip navigation …

What problem does this paper attempt to address?

Image Enhanced Event Detection in News Articles

Meihan Tong,Shuai Wang,Yixin Cao,Bin Xu,Juaizi Li,Lei Hou,Tat-Seng Chua

DOI: https://doi.org/10.1609/aaai.v34i05.6437

2020-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Event detection is a crucial and challenging sub-task of event extraction, which suffers from a severe ambiguity issue of trigger words. Existing works mainly focus on using textual context information, while there naturally exist many images accompanied by news articles that are yet to be explored. We believe that images not only reflect the core events of the text, but are also helpful for the disambiguation of trigger words. In this paper, we first contribute an image dataset supplement to ED benchmarks (i.e., ACE2005) for training and evaluation. We then propose a novel Dual Recurrent Multimodal Model, DRMM, to conduct deep interactions between images and sentences for modality features aggregation. DRMM utilizes pre-trained BERT and ResNet to encode sentences and images, and employs an alternating dual attention to select informative features for mutual enhancements. Our superior performance compared to six state-of-art baselines as well as further ablation studies demonstrate the significance of image modality and effectiveness of the proposed architecture. The code and image dataset are avaliable at https://github.com/shuaiwa16/image-enhanced-event-extraction.
Word Embedding Based Chinese News Event Detection and Representation

Bin ZHANG,Linmei HU,Lei HOU,Juanzi LI

DOI: https://doi.org/10.16451/j.cnki.issn1003-6059.201803009

2018-01-01

Abstract:Existing methods of event detection are mainly based on traditional TF-IDF document representation with high dimension and sparse semantics,leading to low efficiency and accuracy. Thus, they are not suitable for large-scale online news event detection. A document representation method based on word embedding is proposed in this paper. By the document representation method, the document representation dimension is reduced, the semantic sparse problem is alleviated and the efficiency and accuracy of document similarity calculation are enhanced. Based on the document representation method, a dynamic online clustering method is proposed for online news event detection. Based on the dynamic online clustering method,both the accuracy and the recall of event detection are improved. Experiments on the standard dataset TDT4 and a real dataset show that the proposed adaptive online event detection method significantly improves the performance of event detection in both efficiency and accuracy compared with the state-of-the-art methods.
Adaptive Online Event Detection in News Streams.

Linmei Hu,Bin Zhang,Lei Hou,Juanzi Li

DOI: https://doi.org/10.1016/j.knosys.2017.09.039

IF: 8.139

2017-01-01

Knowledge-Based Systems

Abstract:Event detection aims to discover news documents that report on the same event and arrange them under the same group. With the explosive growth of online news, there is a need for event detection to facilitate better navigation for users in news spaces. Existing works usually represent documents based on TF-IDF scheme and use a clustering algorithm for event detection. However, traditional TF-IDF vector representation suffers problems of high dimension and sparse semantics. In addition, with more news documents coming, IDF need to be incrementally updated. In this paper, we present a novel document representation method based on word embeddings, which reduces the dimension and alleviates the sparse semantics compared to TF-IDF, and thus improves the efficiency and accuracy. Based on the document representation, we propose an adaptive online clustering method for online news event detection, which improves both the precision and recall by using time slicing and event merging respectively. The resulted events are further improved by an adaptive post-processing step which can automatically detect noisy events and further process them. Experiments on standard and real-world datasets show that our proposed adaptive online event detection method significantly improves the performance of event detection in terms of both efficiency and accuracy compared to state-of-the-art methods.
Online Event Detection in News Stream

CHEN Wei,ZHANG Cheng,WANG Can,BU Jia-jun,CHEN Chun,CHEN Hong

DOI: https://doi.org/10.3785/j.issn.1008-973x.2011.06.007

2011-01-01

Abstract:Event detection in news stream is an important research area in topic detection and tracking community.Unfortunately,most of the existing event detection methods are offline and inaccurate.An online event detection algorithm in news stream was introduced.An event consists of a set of bursty features that demonstrates bursty rises in corresponding keywords frequency as the related events emerge.Goodness-of-fit test was applied to find out these features with obvious changes in distribution of term frequency in a news document.Left side significance test was further used to validate all the bursty features occurred in a time span.Finally,evolutionary spectral clustering was applied to group highly correlated bursty features into bursty events.Experiments on the Reuters Corpus Volume 1 show that the proposed method can effectively identify bursty features and timely detect events.The detected events are consistent with corresponding events in real life.
Mining Event Temporal Boundaries from News Corpora Through Evolution Phase Discovery

Liang Kong,Rui Yan,Han Jiang,Yan Zhang,Yan Gao,Li Fu

DOI: https://doi.org/10.1007/978-3-642-23535-1_47

2011-01-01

Abstract:Currently news flood spreads throughout the web. The techniques of Event Detection and Tracking makes it feasible to gather and structure text information into events which are constructed online automatically and updated temporally. Users are usually eager to browse the whole event evolution. With the huge quantity of documents, it is almost impossible for users to read all of them. In this paper, we formally define the problem of event evolution phases discovery. We introduce a novel and principled model (called EPD), aiming at temporally outlining the entire news development. A news document is usually not atomic but consists of independent news segments related to the same event. Therefore we first employ a latent ingredients extraction method to extract event snippets. Unlike traditional clustering methods, we propose a novel metrics integrating content feature, temporal feature, distribution feature and bursty feature to measure the correlation between snippets along timeline in a specific event. Combined with bursty feature, we introduce a novel method to compute word weight. We employ HAC to group the news snippets into diversified phases. An optimization problem are utilized to decide the number of phases, which makes EPD applied. With our novel evaluation method, empirical experiments on two real datasets show that EPD is effective and outperforms various related algorithms. Automatic event chronicle generated is introduced as a typical application of EPD.
OntoED: Low-resource Event Detection with Ontology Embedding

Shumin Deng,Ningyu Zhang,Luoqiu Li,Hui Chen,Huaixiao Tou,Mosha Chen,Fei Huang,Huajun Chen

DOI: https://doi.org/10.18653/v1/2021.acl-long.220

2021-01-01

Abstract:Event Detection (ED) aims to identify event trigger words from a given text and classify it into an event type. Most of current methods to ED rely heavily on training instances, and almost ignore the correlation of event types. Hence, they tend to suffer from data scarcity and fail to handle new unseen event types. To address these problems, we formulate ED as a process of event ontology population: linking event instances to pre-defined event types in event ontology, and propose a novel ED framework entitled OntoED with ontology embedding. We enrich event ontology with linkages among event types, and further induce more event-event correlations. Based on the event ontology, OntoED can leverage and propagate correlation knowledge, particularly from datarich to data-poor event types. Furthermore, OntoED can be applied to new unseen event types, by establishing linkages to existing ones. Experiments indicate that OntoED is more predominant and robust than previous approaches to ED, especially in data-scarce scenarios.
A Multi-stage Method for Chinese Text Detection in News Videos

Yaqi Wang,Liangrui Peng,Shengjin Wang

DOI: https://doi.org/10.1016/j.procs.2016.08.186

2016-01-01

Procedia Computer Science

Abstract:With the rapid increase of on-line video resources, there is an urgent demand for text detection and recognition technologies to build content-based video indexing and retrieval systems. Chinese news video texts contain highly condensed and rich information, but the low resolution of videos on the Internet and the complexity of Chinese character structures bring challenges for text detection. In this paper, we present a multi-stage scheme for Chinese news video text detection. We propose an improved Stroke Width Transform (SWT) method by incorporating text color consistency constraint for candidate text blocks generation. Then we use “divide and conquer” strategy to distinguish candidate text blocks into three sub-spaces according to their geometric shapes and size. For each sub-space, a neural network is designed to filter the candidates into text or non-text blocks. Finally, the text blocks are merged into text lines based on the stroke width, color and other heuristic information. Experimental results on self-collected Chinese news video dataset and ICDAR 2013 dataset show that the proposed method is effective to detect both news video captions and scene texts.
Hierarchical Semantic Enhancement Network for Multimodal Fake News Detection

Qiang Zhang,Jiawei Liu,Fanrui Zhang,Jingyi Xie,Zheng-Jun Zha

DOI: https://doi.org/10.1145/3581783.3612423

2023-01-01

Abstract:The explosion of multimodal fake news content on social media has sparked widespread concern. Existing multimodal fake news detection methods have made significant contributions to the development of this field, but fail to adequately exploit the potential semantic information of images and ignore the noise embedded in news entities, which severely limits the performance of the models. In this paper, we propose a novel Hierarchical Semantic Enhancement Network (HSEN) for multimodal fake news detection by learning text-related image semantic and precise news high-order knowledge semantic information. Specifically, to complement the image semantic information, HSEN utilizes textual entities as the prompt subject vocabulary and applies reinforcement learning to discover the optimal prompt format for generating image captions specific to the corresponding textual entities, which contain multi-level cross-modal correlation information. Moreover, HSEN extracts visual and textual entities from image and text, and identifies additional visual entities from image captions to extend image semantic knowledge. Based on that, HSEN exploits an adaptive hard attention mechanism to automatically select strongly related news entities and remove irrelevant noise entities to obtain precise high-order knowledge semantic information, while generating attention mask for guiding cross-modal knowledge interaction. Extensive experiments show that our method outperforms state-of-the-art methods.
Mining Multi-aspect Reflection of News Events in Twitter: Discovery, Linking and Presentation

Jingjing Wang,Wenzhu Tong,Hongkun Yu,Min Li,Xiuli Ma,Haoyan Cai,Tim Hanratty,Jiawei Han

DOI: https://doi.org/10.1109/ICDM.2015.112

2015-01-01

Abstract:A major event often has repercussions on both news media and microblogging sites such as Twitter. Reports from mainstream news agencies and discussions from Twitter complement each other to form a complete picture. An event can have multiple aspects (sub-events) describing it from multiple angles, each of which attracts opinions/comments posted on Twitter. Mining such reflections is interesting to both policy makers and ordinary people seeking information. In this paper, we propose a unified framework to mine multi-aspect reflections of news events in Twitter. We propose a novel and efficient dynamic hierarchical entity-aware event discovery model to learn news events and their multiple aspects. The aspects of an event are linked to their reflections in Twitter by a bootstrapped dataless classification scheme, which elegantly handles the challenges of selecting informative tweets under overwhelming noise and bridging the vocabularies of news and tweets. In addition, we demonstrate that our framework naturally generates an informative presentation of each event with entity graphs, time spans, news summaries and tweet highlights to facilitate user digestion.
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection.

Yaqing Wang,Fenglong Ma,Zhiwei Jin,Ye Yuan,Guangxu Xun,Kishlay Jha,Lu Su,Jing Gao

DOI: https://doi.org/10.1145/3219819.3219903

2018-01-01

Abstract:As news reading on social media becomes more and more popular, fake news becomes a major issue concerning the public and government. The fake news can take advantage of multimedia content to mislead readers and get dissemination, which can cause negative effects or even manipulate the public events. One of the unique challenges for fake news detection on social media is how to identify fake news on newly emerged events. Unfortunately, most of the existing approaches can hardly handle this challenge, since they tend to learn event-specific features that can not be transferred to unseen events. In order to address this issue, we propose an end-to-end framework named Event Adversarial Neural Network (EANN), which can derive event-invariant features and thus benefit the detection of fake news on newly arrived events. It consists of three main components: the multi-modal feature extractor, the fake news detector, and the event discriminator. The multi-modal feature extractor is responsible for extracting the textual and visual features from posts. It cooperates with the fake news detector to learn the discriminable representation for the detection of fake news. The role of event discriminator is to remove the event-specific features and keep shared features among events. Extensive experiments are conducted on multimedia datasets collected from Weibo and Twitter. The experimental results show our proposed EANN model can outperform the state-of-the-art methods, and learn transferable feature representations.
Improving Event Detection via Open-domain Trigger Knowledge

Meihan Tong,Bin Xu,Shuai Wang,Yixin Cao,Lei Hou,Juanzi Li,Jun Xie

DOI: https://doi.org/10.18653/v1/2020.acl-main.522

2020-01-01

Abstract:Event Detection (ED) is a fundamental task in automatically structuring texts. Due to the small scale of training data, previous methods perform poorly on unseen/sparsely labeled trigger words and are prone to overfitting densely labeled trigger words. To address the issue, we propose a novel Enrichment Knowledge Distillation (EKD) model to leverage external open-domain trigger knowledge to reduce the in-built biases to frequent trigger words in annotations. Experiments on benchmark ACE2005 show that our model outperforms nine strong baselines, is especially effective for unseen/sparsely labeled trigger words. The source code is released on https://github. com/shuaiwa16/ekd. git.
A finegrained digestion of news webpages through Event Snippet Extraction.

Rui Yan,Liang Kong,Yu Li,Yan Zhang,Xiaoming Li

DOI: https://doi.org/10.1145/1963192.1963272

2011-01-01

Abstract:We describe a framework to digest news webpages in finer granularity: to extract event snippets from contexts. "Events" are atomic text snippets and a news article is constituted by more than one event snippet. Event Snippet Extraction (ESE) aims to mine these snippets out. The problem is important because its solutions may be applied to many information mining and retrieval tasks. The challenge is to exploit rich features to detect snippet boundaries, including various semantic, syntactic and visual features. We run experiments to present the effectiveness of our approaches.
Semantic‐enhanced multimodal fusion network for fake news detection

Shuo Li,Tao Yao,Saifei Li,Lianshan Yan

DOI: https://doi.org/10.1002/int.23084

IF: 8.993

2022-09-23

International Journal of Intelligent Systems

Abstract:The increasing popularity of social media facilitates the propagation of fake news, posing a major threat to the government and journalism, and thereby making how to detect fake news from social media an urgent requirement. In general, multimodal‐based methods can achieve better performance because of the complementation among different modalities. However, the majority of them simply concatenate features from different modalities, failing to well preserve the mutual information in common features. To address this issue, a novel framework named semantic‐enhanced multimodal fusion network is proposed for fake news detection, which can better capture mutual features among events and thus benefit the detection of fake news. This model consists of three subnetworks, namely multimodal fusion and event domain adaptation networks as well as the fake news detector. Specifically, the multimodal fusion network aims to extract deep features from texts and images and fuse them into a common semantic feature known as a snapshot. Then, the fake news detector can learn the representation of posts. Finally, the event domain adaptation network can single out and remove the peculiar features of each event, and keep shared features among events. The experimental results show that the proposed model outperforms some state‐of‐the‐art approaches on two real‐world multimedia data sets.

computer science, artificial intelligence
Fake news detection for epidemic emergencies via deep correlations between text and images

Jiangfeng Zeng,Yin Zhang,Xiao Ma

DOI: https://doi.org/10.1016/j.scs.2020.102652

IF: 11.7

2021-03-01

Sustainable Cities and Society

Abstract:<p>In recent years, major emergencies have occurred frequently all over the world. When a major global public heath emergency like COVID-19 broke out, an increasing number of fake news in social media networks are exposed to the public. Automatically detecting the veracity of a news article ensures people receive truthful information, which is beneficial to the epidemic prevention and control. However, most of the existing fake news detection methods focus on inferring clues from text-only content, which ignores the semantic correlations across multimodalities. In this work, we propose a novel approach for Fake News Detection by comprehensively mining the Semantic Correlations between Text content and Images attached (FND-SCTI). First, we learn image representations via the pretrained VGG model, and use them to enhance the learning of text representation via hierarchical attention mechanism. Second, a multimodal variational autoencoder is exploited to learn a fused representation of textual and visual content. Third, the image-enhanced text representation and the multimodal fusion eigenvector are combined to train the fake news detector. Experimental results on two real-world fake news datasets, Twitter and Weibo, demonstrate that our model outperforms seven competitive approaches, and is able to capture the semantic correlations among multimodal contents.</p>

energy & fuels,construction & building technology,green & sustainable science & technology
Unsupervised Key Event Detection from Massive Text Corpora

Yunyi Zhang,Fang Guo,Jiaming Shen,Jiawei Han

DOI: https://doi.org/10.48550/arXiv.2206.04153

2022-06-08

Computation and Language

Abstract:Automated event detection from news corpora is a crucial task towards mining fast-evolving structured knowledge. As real-world events have different granularities, from the top-level themes to key events and then to event mentions corresponding to concrete actions, there are generally two lines of research: (1) theme detection identifies from a news corpus major themes (e.g., "2019 Hong Kong Protests" vs. "2020 U.S. Presidential Election") that have very distinct semantics; and (2) action extraction extracts from one document mention-level actions (e.g., "the police hit the left arm of the protester") that are too fine-grained for comprehending the event. In this paper, we propose a new task, key event detection at the intermediate level, aiming to detect from a news corpus key events (e.g., "HK Airport Protest on Aug. 12-14"), each happening at a particular time/location and focusing on the same topic. This task can bridge event understanding and structuring and is inherently challenging because of the thematic and temporal closeness of key events and the scarcity of labeled data due to the fast-evolving nature of news articles. To address these challenges, we develop an unsupervised key event detection framework, EvMine, that (1) extracts temporally frequent peak phrases using a novel ttf-itf score, (2) merges peak phrases into event-indicative feature sets by detecting communities from our designed peak phrase graph that captures document co-occurrences, semantic similarities, and temporal closeness signals, and (3) iteratively retrieves documents related to each key event by training a classifier with automatically generated pseudo labels from the event-indicative feature sets and refining the detected key events using the retrieved documents. Extensive experiments and case studies show EvMine outperforms all the baseline methods and its ablations on two real-world news corpora.
Improved Retrospective Event Detection Algorithm

Juanzi Li

2008-01-01

Abstract:This paper proposed an algorithm utilizing several methods to address the problem.It used extraction to reduce the vector space model of the news and selected the keyword that could represent the news story mostly.It proposed a hierarchical clustering algorithm utilizing news metadata for similarity computing in a unified framework.Furthermore,based on this approach,it built an on-line news search system,which provided functions to organize news data into news event,and furthermore provided personalized service for users.Experimental results on news data from Xinhua News agency show that both the proposed approaches can effectively improve the performance of RED task,compare to the baseline method.
Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues

Peng Qi,Juan Cao,Xirong Li,Huan Liu,Qiang Sheng,Xiaoyue Mi,Qin He,Yongbiao Lv,Chenyang Guo,Yingchao Yu

DOI: https://doi.org/10.1145/3474085.3481548

2021-10-17

Abstract:Recently, fake news with text and images have achieved more effective diffusion than text-only fake news, raising a severe issue of multimodal fake news detection. Current studies on this issue have made significant contributions to developing multimodal models, but they are defective in modeling the multimodal content sufficiently. Most of them only preliminarily model the basic semantics of the images as a supplement to the text, which limits their performance on detection. In this paper, we find three valuable text-image correlations in multimodal fake news: entity inconsistency, mutual enhancement, and text complementation. To effectively capture these multimodal clues, we innovatively extract visual entities (such as celebrities and landmarks) to understand the news-related high-level semantics of images, and then model the multimodal entity inconsistency and mutual enhancement with the help of visual entities. Moreover, we extract the embedded text in images as the complementation of the original text. All things considered, we propose a novel entity-enhanced multimodal fusion framework, which simultaneously models three cross-modal correlations to detect diverse multimodal fake news. Extensive experiments demonstrate the superiority of our model compared to the state of the art.
Image Captioning in news report scenario

Tianrui Liu,Qi Cai,Changxin Xu,Bo Hong,Jize Xiong,Yuxin Qiao,Tsungwei Yang

2024-04-02

Abstract:Image captioning strives to generate pertinent captions for specified images, situating itself at the crossroads of Computer Vision (CV) and Natural Language Processing (NLP). This endeavor is of paramount importance with far-reaching applications in recommendation systems, news outlets, social media, and beyond. Particularly within the realm of news reporting, captions are expected to encompass detailed information, such as the identities of celebrities captured in the images. However, much of the existing body of work primarily centers around understanding scenes and actions. In this paper, we explore the realm of image captioning specifically tailored for celebrity photographs, illustrating its broad potential for enhancing news industry practices. This exploration aims to augment automated news content generation, thereby facilitating a more nuanced dissemination of information. Our endeavor shows a broader horizon, enriching the narrative in news reporting through a more intuitive image captioning framework.

Artificial Intelligence
Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability

Yejun Yoon,Seunghyun Yoon,Kunwoo Park

2024-06-07

Abstract:This paper addresses the critical challenge of assessing the representativeness of news thumbnail images, which often serve as the first visual engagement for readers when an article is disseminated on social media. We focus on whether a news image represents the actors discussed in the news text. To serve the challenge, we introduce NewsTT, a manually annotated dataset of 1000 news thumbnail images and text pairs. We found that the pretrained vision and language models, such as BLIP-2, struggle with this task. Since news subjects frequently involve named entities or proper nouns, the pretrained models could have a limited capability to match news actors' visual and textual appearances. We hypothesize that learning to contrast news text with its counterfactual, of which named entities are replaced, can enhance the cross-modal matching ability of vision and language models. We propose CFT-CLIP, a contrastive learning framework that updates vision and language bi-encoders according to the hypothesis. We found that our simple method can boost the performance for assessing news thumbnail representativeness, supporting our assumption. Code and data can be accessed at <a class="link-external link-https" href="https://github.com/ssu-humane/news-images-acl24" rel="external noopener nofollow">this https URL</a>.

Computation and Language,Computer Vision and Pattern Recognition
NEI: A Framework for Dynamic News Event Exploration and Visualization

Xiaofei Guo,Juanzi Li,Ruibing Yang,Xiaoli Ma

DOI: https://doi.org/10.1145/2636240.2636845

2014-01-01

Abstract:Nowadays, there are many events reported by News Media everyday, which contains a massive number of news. People are getting more and more interested in understanding how an event evolves after it happens. News related to the same event or similar events usually has more common entities and stronger topic correlations, which is a new perspective to study news event. Due to the complexity of event evolving process, event visualization has been a big challenge for a long time. In this paper, we design a novel four-phase framework NEI(News Event Insight) that focuses on visualizing a news event properly and clearly, namely (1)Entity Topic Modeling. We extract topics and entities through timeline. (2)Temporal Topic Correlation Analysis. Based on the topic modeling result, we design two methods to select hot topics and build links for them. (3)Keyword Extraction. Specially, we combine string frequency with syntax features and use language models to acquire candidate keywords for representing topics. (4)Visualization. Visualization demonstrates the quantifying properties of topics related to a certain event. A case study shows our framework achieves promising results on both single event and similar events.

Image Enchanced Event Detection in News Articles. Meihan Tong, Shuai Wang

Image Enhanced Event Detection in News Articles

Word Embedding Based Chinese News Event Detection and Representation

Adaptive Online Event Detection in News Streams.

Online Event Detection in News Stream

Mining Event Temporal Boundaries from News Corpora Through Evolution Phase Discovery

OntoED: Low-resource Event Detection with Ontology Embedding

A Multi-stage Method for Chinese Text Detection in News Videos

Hierarchical Semantic Enhancement Network for Multimodal Fake News Detection

Mining Multi-aspect Reflection of News Events in Twitter: Discovery, Linking and Presentation

EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection.

Improving Event Detection via Open-domain Trigger Knowledge

A finegrained digestion of news webpages through Event Snippet Extraction.

Semantic‐enhanced multimodal fusion network for fake news detection

Fake news detection for epidemic emergencies via deep correlations between text and images

Unsupervised Key Event Detection from Massive Text Corpora

Improved Retrospective Event Detection Algorithm

Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues

Image Captioning in news report scenario

Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability

NEI: A Framework for Dynamic News Event Exploration and Visualization