Abstract:Identifying traffic accidents in driving videos is crucial to ensuring the safety of autonomous driving and driver assistance systems. To address the potential danger caused by the long-tailed distribution of driving events, existing traffic accident detection (TAD) methods mainly rely on unsupervised learning. However, TAD is still challenging due to the rapid movement of cameras and dynamic scenes in driving scenarios. Existing unsupervised TAD methods mainly rely on a single pretext task, i.e., an appearance-based or future object localization task, to detect accidents. However, appearance-based approaches are easily disturbed by the rapid movement of the camera and changes in illumination, which significantly reduce the performance of traffic accident detection. Methods based on future object localization may fail to capture appearance changes in video frames, making it difficult to detect ego-involved accidents (e.g., out of control of the ego-vehicle). In this paper, we propose a novel memory-augmented multi-task collaborative framework (MAMTCF) for unsupervised traffic accident detection in driving videos. Different from previous approaches, our method can more accurately detect both ego-involved and non-ego accidents by simultaneously modeling appearance changes and object motions in video frames through the collaboration of optical flow reconstruction and future object localization tasks. Further, we introduce a memory-augmented motion representation mechanism to fully explore the interrelation between different types of motion representations and exploit the high-level features of normal traffic patterns stored in memory to augment motion representations, thus enlarging the difference from anomalies. Experimental results on recently published large-scale dataset demonstrate that our method achieves better performance compared to previous state-of-the-art approaches.

Multi-view context awareness based transport stay hotspot recognizing

From Time to Space: Automatic Annotation of Unmarked Traffic Scene Based on Trajectory Data.

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Trajectory-as-a-Sequence: A Novel Travel Mode Identification Framework

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

TAS-TsC: A Data-Driven Framework for Estimating Time of Arrival Using Temporal-Attribute-Spatial Tri-space Coordination of Truck Trajectories

Transportation Mode Detection Combining CNN and Vision Transformer with Sensors Recalibration Using Smartphone Built-In Sensors

Development of a global positioning system data-based trip-purpose inference method for hazardous materials transportation management

Multi-modal Tag Localization for Mobile Video Search.

MCTN-Net: A Multiclass Transportation Network Extraction Method Combining Orientation and Semantic Features

A Novel One-Stage Approach for Pointwise Transportation Mode Identification Inspired by Point Cloud Processing

A Memory-Augmented Multi-Task Collaborative Framework for Unsupervised Traffic Accident Detection in Driving Videos

Traffic Sign Recognition With Lightweight Two-Stage Model in Complex Scenes

AGMG-Net: Leveraging multiscale and fine-grained features for improved cargo recognition

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

Multi-View Spatial-Temporal Model for Travel Time Estimation

A Robust Deep Affinity Network for Multiple Ship Tracking

Multiple Areal Feature Aware Transportation Demand Prediction

M3PT: A Multi-Modal Model for POI Tagging

A One-Stage Framework for Point-Based Transportation Mode Identification Using Gps Data