On The Power of Subtle Expressive Cues in the Perception of Human Affects

Ezgi Dede,Kamile Asli Agilonu,Ergun Akleman,Metin Sezgin
2024-02-01
Abstract:In this study, we introduce a sketch-based method for testing how subtle expressive cues influence the perception of affect in illustrations of human figures. We specifically study the impact of human posture and gaze direction, implicitly specified through nose orientation, on perceived emotions and mood. Through a series of user studies using sketchy illustrations of a running figure, where a professional illustrator manipulated gaze direction through adjustments on the nose orientation, we found that this simple change resulted in a diverse range of perceived affects, spanning from fear to concern and wonder. These findings shed light on the importance of fine details in defining context for context-aware system designs and underscore the importance of recognizing and expressing affect. Understanding minor expressive cues is crucial to developing emotionally intelligent systems capable of expressing affect.
Human-Computer Interaction
What problem does this paper attempt to address?
The paper attempts to address the issue of understanding how subtle expressive cues (such as body posture and gaze direction) influence human emotion perception. Specifically, the authors explore the importance of these subtle cues in defining contexts by studying the impact of body posture and gaze direction (implicitly specified by the direction of the nose) on the perception of emotions and moods. ### Background and Motivation - **Importance of Understanding Human Emotions**: Understanding human emotional expression is crucial in applications such as affective computing, context-aware systems, and visual storytelling. - **Limitations of Existing Research**: Most current research focuses on facial, vocal, and gestural expressions, neglecting the role of other subtle expressive cues like body posture and gaze direction. - **Impact of Subtle Cues**: Studies have shown that even small detail changes (such as a few drops of water) can significantly alter and amplify emotional expression. ### Research Methodology - **Experimental Design**: The authors developed a sketch-based approach to test the impact of subtle expressive cues through user studies. - **Dataset Creation**: A series of sketches of running figures were drawn by professional illustrators, with gaze direction altered by adjusting the direction of the nose. - **User Study**: Volunteers were shown these sketches and asked to describe what was happening in the scene and the emotional state of the characters. ### Key Findings - **Impact of Gaze Direction**: Changing the direction of the nose and eyes, even while keeping other parts of the body unchanged, can create different contexts and emotions. - **Variation in Emotional Intensity**: Postures looking backward elicited more negative emotions and higher emotional intensity compared to forward-looking postures. - **Impact of Upward and Downward Gaze**: Upward-looking postures elicited higher positive emotional intensity, while downward-looking postures elicited higher negative emotional intensity. ### Conclusion - **Importance of Subtle Cues**: The findings indicate that subtle expressive cues (such as gaze direction) play a significant role in defining context and emotional expression. - **Future Work**: Future research can further analyze contexts and their elements to improve the performance and user experience of intelligent user interfaces. ### Summary The paper demonstrates through experiments the significant impact of subtle expressive cues (such as gaze direction) on human emotion perception, emphasizing the importance of considering these cues in the design of context-aware systems.