Abstract:Advances in computer and communications technology have deeply affected the way we communicate. Social media have emerged as a major means of human communication. However, a major limitation in such media is the lack of non-verbal stimuli, which sometimes hinders the understanding of the message, and in particular the associated emotional content. In an effort to compensate for this, people started to use emoticons, which are combinations of keyboard characters that resemble facial expressions, and more recently their evolution: emojis, namely, small colorful images that resemble faces, actions and daily life objects. This paper presents evidence of the effect of emojis on memory retrieval through a functional Magnetic Resonance Imaging (fMRI) study. A total number of fifteen healthy volunteers were recruited for the experiment, during which successive stimuli were presented, containing words with intense emotional content combined with emojis, either with congruent or incongruent emotional content. Volunteers were asked to recall a memory related to the stimulus. The study of the reaction times showed that emotional incongruity among word+emoji combinations led to longer reaction times in memory retrieval compared to congruent combinations. General Linear Model (GLM) and Blind Source Separation (BSS) methods have been tested in assessing the influence of the emojis on the process of memory retrieval. The analysis of the fMRI data showed that emotional incongruity among word+emoji combinations activated the Broca's area (BA44 and BA45) in both hemispheres, the Supplementary Motor Area (SMA) and the inferior prefrontal cortex (BA47), compared to congruent combinations. Furthermore, compared to pseudowords, word+emoji combinations activated the left Broca's area (BA44 and BA45), the amygdala, the right temporal pole (BA48) and several frontal regions including the SMA and the inferior prefrontal cortex.

The Effects of Adding Emojis to Text Messages on Emotional Impressions and Recollection of Textual Content

Emojis influence emotional communication, social attributions, and information processing

Emojis influence autobiographical memory retrieval from reading words: An fMRI-based study

Emoji Alter the Perception of Emotion in Affectively Neutral Text messages

Emoticons' Influence on Advice Taking

Exploring the (lack of) facilitative effect of emoji for word processing

Emojis as social information in digital communication.

Mad or mad-mad: conveying subtle emotion with face emoji

Factors Influencing Emoji Usage in Smartphone Mediated Communications.

Spice up Your Chat: The Intentions and Sentiment Effects of Using Emoji

The semiotics of emojis in advertising: An integrated quantitative and qualitative examination of emotional versus functional ad dynamics

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emojifying Chatbot Interactions: an Exploration of Emoji Utilization in Human-Chatbot Communications

The Influence of Emoji on the Internet Text Perception

How the Use of Animated Versus Static Emojis in Online Post-Purchase Communication Affects Consumer Attitude

Emoji Your Story: The Advertising Effectiveness of Emoji-Based Narratives

Emotional Expression Online: the Impact of Task, Relationship and Personality Perception on Emoticon Usage in Instant Messenger

Emoji Identification and Emoji Effects on Sentence Emotionality in ASD-Diagnosed Adults and Neurotypical Controls

An Empirical Study on the Effect of Emoticon Stickers Usage on Information Communication in Social Media: Based on Speech Act Theory

Color Affects Recognition of Emoticon Expressions

The value of a real face: Differences between affective faces and emojis in neural processing and their social influence on decision-making