Abstract:Identifying traffic accidents in driving videos is crucial to ensuring the safety of autonomous driving and driver assistance systems. To address the potential danger caused by the long-tailed distribution of driving events, existing traffic accident detection (TAD) methods mainly rely on unsupervised learning. However, TAD is still challenging due to the rapid movement of cameras and dynamic scenes in driving scenarios. Existing unsupervised TAD methods mainly rely on a single pretext task, i.e., an appearance-based or future object localization task, to detect accidents. However, appearance-based approaches are easily disturbed by the rapid movement of the camera and changes in illumination, which significantly reduce the performance of traffic accident detection. Methods based on future object localization may fail to capture appearance changes in video frames, making it difficult to detect ego-involved accidents (e.g., out of control of the ego-vehicle). In this paper, we propose a novel memory-augmented multi-task collaborative framework (MAMTCF) for unsupervised traffic accident detection in driving videos. Different from previous approaches, our method can more accurately detect both ego-involved and non-ego accidents by simultaneously modeling appearance changes and object motions in video frames through the collaboration of optical flow reconstruction and future object localization tasks. Further, we introduce a memory-augmented motion representation mechanism to fully explore the interrelation between different types of motion representations and exploit the high-level features of normal traffic patterns stored in memory to augment motion representations, thus enlarging the difference from anomalies. Experimental results on recently published large-scale dataset demonstrate that our method achieves better performance compared to previous state-of-the-art approaches.

TIF: Trajectory and Information Flow Coupling Mechanism for Behavior Analysis in Autonomous Driving.

From Time to Space: Automatic Annotation of Unmarked Traffic Scene Based on Trajectory Data.

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Public Place Crowd Transaction Monitoring System

Driving Behavior Tracking and Recognition Based on Multisensors Data Fusion

The Large-Scale Crowd Behavior Perception Based on Spatio-Temporal Viscous Fluid Field

An Intelligent Extraversion Analysis Scheme from Crowd Trajectories for Surveillance

Graph Optimized Data Offloading for Crowd-AI Hybrid Urban Tracking in Intelligent Transportation Systems

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

Vehicle Feature Point Trajectory Clustering and Vehicle Behavior Analysis in Complex Traffic Scenes.

Adaptive Visual Interaction Based Multi-Target Future State Prediction For Autonomous Driving Vehicles

A Memory-Augmented Multi-Task Collaborative Framework for Unsupervised Traffic Accident Detection in Driving Videos

Understanding urban structures and crowd dynamics leveraging large-scale vehicle mobility data

Crowd Behavior Analysis Via Curl and Divergence of Motion Trajectories

Artificial Intelligence Aided Crowd Analytics in Rail Transit Station

Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles

Modeling social interaction and intention for pedestrian trajectory prediction

A Flow Base Bi-path Network for Cross-scene Video Crowd Understanding in Aerial View