Abstract:An agent’s ability to predict a human’s intention can facilitate the effectiveness of a human-agent team. The aim of this study was to explore the feasibility of predicting human intention in the hybrid foraging search task using eye gaze data and machine learning. In the hybrid foraging search paradigm, the human performs searches in patches and decides to stay and exploit a patch or to leave and explore another patch. Researchers have modeled the “patch-leaving problem” on the collective level using the marginal value theorem. However, few have attempted to predict the exact moment when the human will leave. In the current study, 40 participants performed the hybrid foraging search task while eye gaze data were collected with an eye-tracker. The leaving intention was associated with larger pupil size, shorter average fixation duration, larger number of fixations, longer saccade amplitude, and faster saccade velocity compared to the searching intention. A cross-subject machine learning model with an artificial neural network algorithm was able to predict whether a participant would leave the current patch with up to 78% accuracy with a 2-second data analysis window. The length of the data analysis window did not significantly affect prediction accuracy. Furthermore, the earlier the behavior prediction was made, the lower the reliability of the prediction. These results demonstrate that eye gaze features and machine learning algorithms are useful in predicting human intention in visual search tasks.

Towards Open Environment Intent Prediction.

Towards Open Intent Detection

The Open-World Lottery Ticket Hypothesis for OOD Intent Classification

Continual Generalized Intent Discovery: Marching Towards Dynamic and Open-world Intent Recognition

Open World Classification with Adaptive Negative Samples.

Two Birds One Stone: Dynamic Ensemble for OOD Intent Classification

Open Intent Extraction from Natural Language Interactions

Unknown Intention Detection Method Based on Dynamic Constraint Boundary

A Hybrid Architecture for Out of Domain Intent Detection and Intent Discovery

KNN-Contrastive Learning for Out-of-Domain Intent Classification

Learning Discriminative Representations and Decision Boundaries for Open Intent Detection

Discovering New Intents Using Latent Variables

Deep Open Intent Classification with Adaptive Decision Boundary

Open Intent Extraction from Natural Language Interactions (Extended Abstract)

Learning to Classify Open Intent via Soft Labeling and Manifold Mixup

Estimating Soft Labels for Out-of-Domain Intent Detection

APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training

Gaze-based Human Intention Prediction in the Hybrid Foraging Search Task