Abstract:In computer vision, video-based approaches have been widely explored for the early classification and the prediction of actions or activities. However, it remains unclear whether this modality (as compared to 3D kinematics) can still be reliable for the prediction of human intentions, defined as the overarching goal embedded in an action sequence. Since the same action can be performed with different intentions, this problem is more challenging but yet affordable as proved by quantitative cognitive studies which exploit the 3D kinematics acquired through motion capture systems. In this paper, we bridge cognitive and computer vision studies, by demonstrating the effectiveness of video-based approaches for the prediction of human intentions. Precisely, we propose Intention from Motion, a new paradigm where, without using any contextual information, we consider instantaneous grasping motor acts involving a bottle in order to forecast why the bottle itself has been reached (to pass it or to place in a box, or to pour or to drink the liquid inside). We process only the grasping onsets casting intention prediction as a classification framework. Leveraging on our multimodal acquisition (3D motion capture data and 2D optical videos), we compare the most commonly used 3D descriptors from cognitive studies with state-of-the-art video-based techniques. Since the two analyses achieve an equivalent performance, we demonstrate that computer vision tools are effective in capturing the kinematics and facing the cognitive problem of human intention prediction.

Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos.

Modeling and Inferring Human Intents and Latent Functional Objects for Trajectory Prediction

Inferring &#x0022;dark Matter&#x0022; and &#x0022;dark Energy&#x0022; from Videos

Social Behavior Prediction from First Person Videos

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Inferring Human Attention by Learning Latent Intentions.

Inferring Human Intent from Video by Sampling Hierarchical Plans

What Will I Do Next? The Intention from Motion Experiment

Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks

Learning Human Search Behavior from Egocentric Visual Inputs

Peeking Into the Future: Predicting Future Person Activities and Locations in Videos

Human Trajectory Prediction using Spatially aware Deep Attention Models

Modeling social interaction and intention for pedestrian trajectory prediction

Inferring Forces And Learning Human Utilities From Videos

Early Detection of Suspicious Behaviors for Safe Residence from Movement Trajectory Data

Local Spatio-Temporal Feature Based Voting Framework for Complex Human Activity Detection and Localization

Discovering Intrinsic Spatial-Temporal Logic Rules to Explain Human Actions

Unsupervised Multi-Target Trajectory Detection, Learning And Analysis In Complicated Environments

Spatio-temporal Interactive Pedestrian Intention Prediction with Illumination Transformation

Local and Global Contextual Features Fusion for Pedestrian Intention Prediction

Latent Dirichlet Allocation for Unsupervised Activity Analysis on an Autonomous Mobile Robot