Abstract:The multiple-object tracking (MOT) task, proposed by Pylyshyn and Storm (1988), requires participants to simultaneously track the positions of several visual objects as they move among identical distractors. Yantis (1992) found that participants used perceptual grouping strategy when tracking multiple moving objects, indicating that moving objects with different identities could facilitate using of grouping strategy to help tracking. In this present study, we used facial expressions of emotions as object identities to investigate grouping strategies during multiple-identity tracking (MIT). With facial expressions of emotion playing an important role in daily life, understanding whether or not the processing of emotions would affect visual objects tracking is a topic of both theoretical and practical importance, compared with studies using physical properties as object identities. There are two experiments in the present study, where the only difference between the two experiments was that there was no eyebrows in the schematic faces used in the second experiment, in order to investigate whether eyebrows affected facial expression processing. We recruited 29 (11 males) and 16 (7 males) undergraduates from the universities in Beijing in Experiment1 and Experiment2, respectively. All the participants gave their consent form and filled in the Self-rating Depression Scale and State-Trait-Anxiety Inventory prior to the experiments. In each trial, eight objects appeared on the screen as blank squares, and four of eight occurred with red frames outside for 1.5 seconds to indicate targets. After that, all the objects turned into expression pictures and started to move randomly and independently for 5 to 6 seconds, and then turned back into blank objects after stopped. The participants' tasks were first to select four targets and then to report the facial expression of each of the four targets they selected. There are three conditions: (1) grouping (Target Grouping, TG); (2) pairing (Target-Distractor Grouping, TDG); and (3) homogenous, in which the identity of all the objects was always the same expression (positive, negative, or neutral). TG condition included subcategories of pairing of identities. There were four conditions, each depicting one of the following: (1) positive targets, negative distractors; (2) positive targets, neutral distractors; (3) negative targets, positive distractors; and (4) negative targets, neutral distractors. While three subcategories were included in the TDG condition: (1) positive and neutral targets (and distractors), (2) positive and negative targets (and distractors), (3) negative and neutral targets (and distractors). We then did relevant analyses to answer the following three questions: 1) did grouping strategy improve tracking performance compared to homogenous condition? 2) did pairing strategy affect the overall tracking performance? 3) did eyebrows of the face images affect facial expression processing which further affect tracking performance? We found similar results in the two experiments: (1) grouping improved tracking performance significantly, compared with homogenous condition; (2) targets with negative expression improved tracking performance significantly, compared with either positive targets or homogenous conditions, indicating an attention bias to negative expression; (3) shared identities between targets and distractors impaired tracking performance, compared with homogenous condition; (4) absence of eyebrows in facial images did not affect processing of negative expressions. In conclusion, we examined grouping strategy in MIT using facial expression as object identities. Our results showed that targets with negative expressions improved tracking performance significantly compared with positive and neural expressions, indicating an attention bias to negative attention. People can not only effectively use location and physical properties information of objects during multiple objects tracking found in previous studies, but also more ecological facial expression information. Our study also provides a new way of investigating perception of facial expressions of emotions in dynamic scenes.

The Effect of Fearful Expressions on Multiple Face Tracking

The Structural and Functional Correlates of the Efficiency in Fearful Face Detection.

The Effect of Emotion Regulation on Visual Search for Faces with Emotional Expressions

Losing Control in Front of a Fearful Face: the Effect of Emotional Information on Cognitive Control

Expression-based Grouping in Multiple Identity Tracking

Influence of Negative Emotion over Attention Allocation in Multiple Objects Tracking.

Beauty is Better Pursued: Effects of Attractiveness in Multiple-Face Tracking

Identity Processing in Multiple-Face Tracking

Prioritized Identification of Fearful Eyes During the Attentional Blink is Not Automatic.

Differential Effects of Fearful Faces under Spatial Attended and Unattended Conditions

Emotion-gaze interaction affects time-to-collision estimates, but not preferred interpersonal distance towards looming faces

Time Course of Influence on the Allocation of Attentional Resources Caused by Unconscious Fearful Faces.

How Does Fearful Emotion Affect Visual Attention?

Early integration of affectively contextual information when processing low-intensity fearful faces: Behavioral and electrophysiological evidence

Different Effects of Attachment Anxiety and Avoidance on Attention to Changing Facial Expressions

Spatial Attention Effects of Disgusted and Fearful Faces

The Effect of Unconscious Emotional Faces on Spatial Attention: an ERP Study

Stimulus-driven and strategic neural responses to fearful and happy facial expressions in humans

The effect of negative emotion on multiple object tracking task: An ERP study.

Gender differences in individual emotion recognition in threatening situations: an eye-tracking study

Differential effects of fearful faces under spatial attended and unattended conditions: evidence from an event-related potential study.