Abstract:Vulnerable road users (VRUs, i.e. cyclists and pedestrians) will play an important role in future traffic. To avoid accidents and achieve a highly efficient traffic flow, it is important to detect VRUs and to predict their intentions. In this article a holistic approach for detecting intentions of VRUs by cooperative methods is presented. The intention detection consists of basic movement primitive prediction, e.g. standing, moving, turning, and a forecast of the future trajectory. Vehicles equipped with sensors, data processing systems and communication abilities, referred to as intelligent vehicles, acquire and maintain a local model of their surrounding traffic environment, e.g. crossing cyclists. Heterogeneous, open sets of agents (cooperating and interacting vehicles, infrastructure, e.g. cameras and laser scanners, and VRUs equipped with smart devices and body-worn sensors) exchange information forming a multi-modal sensor system with the goal to reliably and robustly detect VRUs and their intentions under consideration of real time requirements and uncertainties. The resulting model allows to extend the perceptual horizon of the individual agent beyond their own sensory capabilities, enabling a longer forecast horizon. Concealments, implausibilities and inconsistencies are resolved by the collective intelligence of cooperating agents. Novel techniques of signal processing and modelling in combination with analytical and learning based approaches of pattern and activity recognition are used for detection, as well as intention prediction of VRUs. Cooperation, by means of probabilistic sensor and knowledge fusion, takes place on the level of perception and intention recognition. Based on the requirements of the cooperative approach for the communication a new strategy for an ad hoc network is proposed.

Cyclist Intention Detection: A Probabilistic Approach

Early Start Intention Detection of Cyclists Using Motion History Images and a Deep Residual Network

Intentions of Vulnerable Road Users - Detection and Forecasting by Means of Machine Learning

Intention Recognition of Pedestrians and Cyclists by 2D Pose Estimation

CyclingNet: Detecting cycling near misses from video streams in complex urban scenes with deep learning

Starting Movement Detection of Cyclists Using Smart Devices

Trajectory prediction of cyclist based on dynamic Bayesian network and long short-term memory model at unsignalized intersections

Detecting Intentions of Vulnerable Road Users Based on Collective Intelligence

Pedestrian Motion State Estimation From 2D Pose

A context aware and video-based risk descriptor for cyclists

A New Benchmark For Vison-Based Cyclist Detection

Monocular Cyclist Detection with Convolutional Neural Networks

Cooperative Starting Movement Detection of Cyclists Using Convolutional Neural Networks and a Boosted Stacking Ensemble

Trajectory Prediction of Cyclist Based on Spatial‐temporal Multi‐graph Network in Crowded Scenarios

A new benchmark for vision-based cyclist detection.

Computer vision and statistical insights into cycling near miss dynamics

LSTM based trajectory prediction model for cyclist utilizing multiple interactions with environment

Probabilistic Vehicle Trajectory Prediction Via Driver Characteristic and Intention Estimation Model under Uncertainty

Real-time Intent Prediction of Pedestrians for Autonomous Ground Vehicles via Spatio-Temporal DenseNet

Intent-Aware Probabilistic Trajectory Estimation for Collision Prediction with Uncertainty Quantification

Spatio-temporal deep learning framework for pedestrian intention prediction in urban traffic scenes