Abstract:Existing event stream-based pattern recognition models usually represent the event stream as the point cloud, voxel, image, etc., and design various deep neural networks to learn their features. Although considerable results can be achieved in simple cases, however, the model performance may be limited by monotonous modality expressions, sub-optimal fusion, and readout mechanisms. In this paper, we propose a novel dual-stream framework for event stream-based pattern recognition via differentiated fusion, termed EFV++. It models two common event representations simultaneously, i.e., event images and event voxels. The spatial and three-dimensional stereo information can be learned separately by utilizing Transformer and Graph Neural Network (GNN). We believe the features of each representation still contain both efficient and redundant features and a sub-optimal solution may be obtained if we directly fuse them without differentiation. Thus, we divide each feature into three levels and retain high-quality features, blend medium-quality features, and exchange low-quality features. The enhanced dual features will be fed into the fusion Transformer together with bottleneck features. In addition, we introduce a novel hybrid interaction readout mechanism to enhance the diversity of features as final representations. Extensive experiments demonstrate that our proposed framework achieves state-of-the-art performance on multiple widely used event stream-based classification datasets. Specifically, we achieve new state-of-the-art performance on the Bullying10k dataset, i.e., $90.51\%$, which exceeds the second place by $+2.21\%$. The source code of this paper has been released on \url{<a class="link-external link-https" href="https://github.com/Event-AHU/EFV_event_classification/tree/EFVpp" rel="external noopener nofollow">this https URL</a>}.

A Novel Burst-based Text Representation Model for Scalable Event Detection.

An Online Detection and Tracking Method for Bursty Topics

Online Detection of Bursty Events and Their Evolution in News Streams

Temporal and Social Context Based Burst Detection from Folksonomies.

Event Detection with Burst Information Networks.

Ranking and Tagging Bursty Features in Text Streams with Context Language Models

An Improved System for Sentence-level Novelty Detection in Textual Streams

Online Burst Detection Over High Speed Short Text Streams

Context Modeling for Ranking and Tagging Bursty Features in Text Streams

Burst events detection on micro-blogging.

Online Event Detection in News Stream

Detecting Bursty Events in Collaborative Tagging Systems

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

Identifying Event-related Bursts via Social Media Activities.

Real time event detection in twitter

Probabilistic Topic Model Based Approach for Detecting Bursty Events from Social Media Data

Event Voxel Set Transformer for Spatiotemporal Representation Learning on Event Streams

A Novel Approach to Text Detection and Extraction from Videos by Discriminative Features and Density

Retain, Blend, and Exchange: A Quality-aware Spatial-Stereo Fusion Approach for Event Stream Recognition

A dynamic burst detection model over data streams