What's That Smell?

Esther Shein

DOI: https://doi.org/10.1145/3638042

IF: 22.7

2024-02-22

Communications of the ACM

Abstract:Digital scent technologies bring aromas to virtual reality.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

Unveiling aromas: Virtual reality and scent identification for sensory analysis

Abdul Hannan Bin Zulkarnain,Dalma Radványi,Dorina Szakál,Zoltán Kókai,Attila Gere

DOI: https://doi.org/10.1016/j.crfs.2024.100698

2024-02-15

Abstract:Sensory analysis is crucial for optimizing experiences in various fields, including food, cosmetics, and product design. Traditional methods can be inefficient and imprecise. This study introduces a novel approach by blending Virtual Reality (VR) technology with scent identification techniques. The aim is to investigate whether the visual representation of food products affects scent perception. Limited research has explored the use of VR in scent identification, which is especially relevant when altering the food environment setting. A virtual sensory laboratory was developed to mimic MATE's sensory booth. Sixty participants, all MATE students, were involved in this study. This method offers a potential means to streamline scent identification and reduce human bias in sensory analysis. In summary, the combination of VR technology and scent identification presents a fresh methodological approach to sensory analysis, where both scent and exposure are influenced by the environment or imagery. This concept delves into cross-modal correspondences and the role of sensory cues in shaping our perception of food odours within the VR setting.
ScentClue: Enhancing Story Engagement in Virtual Reality Through Hedonically Varied Olfactory Hints

Yanan Wang,Yucheng Li,Mingyi Yuan,Xiang Fei,Shihang Ma,Preben Hansen

DOI: https://doi.org/10.1080/10447318.2024.2397173

IF: 4.92

2024-09-25

International Journal of Human-Computer Interaction

Abstract:To enhance the engagement and significance of olfaction as a novel medium in multimedia systems, we aim to integrate different hedonic odorous cues into narratives to augment immersion in virtual experiences. We introduce the ScentClue system, comprising (1) an original and murder-themed experimental film incorporating four distinct hedonic odor cues synchronized with audiovisual elements, (2) a neck-worn scent delivery device capable of dispensing four different odors, and (3) an Unreal Engine-based virtual cinema environment enabling rapid control of video playback and odor dissemination. Experimenting with 18 participants divided into control groups with and without odor stimuli, we validated the system's usability and effectiveness of odor cue settings. Furthermore, we found that the use of odors with different hedonic qualities could enhance odor recognition, amplify thematic story ambiance, and aid in the rapid differentiation of complex relationships. Finally, we discussed expanded scenarios and interaction modalities for ScentClue, proposing future narrative-driven olfaction-enhanced multimedia designs with considerations for odor cue settings, odor material selection, and scent-releasing setup, particularly unpleasant odors.

computer science, cybernetics,ergonomics
Scenting Entertainment: Virtual Reality Storytelling, Theme Park Rides, Gambling, and Video-Gaming

Charles Spence

DOI: https://doi.org/10.1177/20416695211034538

2021-08-23

Abstract:There has long been interest in both the tonic and phasic release of scent across a wide range of entertainment settings. While the presentation of semantically congruent scent has often been used in order to enhance people's immersion in a particular context, other generally less successful attempts have involved the pulsed presentation of a range of scents tied to specific events/scenes. Scents have even been released in the context of the casino to encourage the guests to linger for longer (and spend more), at least according to the results of one controversial study. In this narrative review, I want to take a closer look at the use of scent in a range of both physical and digital environments, highlighting the successes (as in the case of scented theme park rides) and frequent failures (as, seemingly, in the context of scent-enabled video games). While digitally inducing meaningful olfactory sensations is likely to remain a pipe dream for the foreseeable future, the digital control of scent release/delivery provides some limited opportunities to enhance the multisensory experience of entertainment. That said, it remains uncertain whether the general public will necessarily perceive the benefit, and hence be willing to pay for the privilege.
Odour enhances the sense of presence in a virtual reality environment

Nicholas S Archer,Andrew Bluff,Andrew Eddy,Chreshall K Nikhil,Nick Hazell,Damian Frank,Andrew Johnston

DOI: https://doi.org/10.1371/journal.pone.0265039

IF: 3.7

2022-03-30

PLoS ONE

Abstract:Virtual reality (VR) headsets provide immersive audio-visual experiences for users, but usually neglect to provide olfactory cues that can provide additional information about our environment in the real world. This paper examines whether the introduction of smells into the VR environment enhances users' experience, including their sense of presence through collection of both psychological and physiological measures. Using precise odour administration with an olfactometer, study participants were exposed to smells while they were immersed in the popular PlayStation VR game "Resident Evil 7". A within-subject study design was undertaken where participants (n = 22) walked-through the same VR environment twice, with or without the introduction of associated congruent odour stimuli. Directly after each gameplay, participants completed a questionnaire to determine their sense of presence from the overall gameplay and their sense of immersion in each of the virtual scenes. Additionally, physiological measurements (heart rate, body temperature and skin electrodermal activity) were collected from participants (n = 11) for each gameplay. The results showed the addition of odours significantly increased participants' sense of spatial presence in the VR environment compared to VR with no odour. Participants also rated the realism of VR experience with odour higher compared to no odour, however odour addition did not result in change in emotional state of participants (arousal, pleasure, dominance). Further, the participants' physiological responses were impacted by the addition of odour. Odour mediated physiological changes were dependent on whether the VR environment was novel, as the effect of odour on physiological response was lost when participants experienced the aroma on the second gameplay. Overall, the results indicate the addition of odours to a VR environment had a significant effect on both the psychological and physiological experience showing the addition of smell enhanced the VR environment. The incorporation of odours to VR environments presents an opportunity to create a more immersive experience to increase a person's presence within a VR environment. In addition to gaming, the results have broader applications for virtual training environments and virtual reality exposure therapy.
Soft, miniaturized, wireless olfactory interface for virtual reality

Yiming Liu,Chun Ki Yiu,Zhao Zhao,Wooyoung Park,Rui Shi,Xingcan Huang,Yuyang Zeng,Kuan Wang,Tsz Hung Wong,Shengxin Jia,Jingkun Zhou,Zhan Gao,Ling Zhao,Kuanming Yao,Jian Li,Chuanlu Sha,Yuyu Gao,Guangyao Zhao,Ya Huang,Dengfeng Li,Qinglei Guo,Yuhang Li,Xinge Yu

DOI: https://doi.org/10.1038/s41467-023-37678-4

IF: 16.6

2023-05-09

Nature Communications

Abstract:Abstract Recent advances in virtual reality (VR) technologies accelerate the creation of a flawless 3D virtual world to provide frontier social platform for human. Equally important to traditional visual, auditory and tactile sensations, olfaction exerts both physiological and psychological influences on humans. Here, we report a concept of skin-interfaced olfactory feedback systems with wirelessly, programmable capabilities based on arrays of flexible and miniaturized odor generators (OGs) for olfactory VR applications. By optimizing the materials selection, design layout, and power management, the OGs exhibit outstanding device performance in various aspects, from response rate, to odor concentration control, to long-term continuous operation, to high mechanical/electrical stability and to low power consumption. Representative demonstrations in 4D movie watching, smell message delivery, medical treatment, human emotion control and VR/AR based online teaching prove the great potential of the soft olfaction interface in various practical applications, including entertainment, education, human machine interfaces and so on.

multidisciplinary sciences
OdorCarousel: A Design Tool for Customizing Smell-Enhanced Virtual Experiences

Xiang Fei,Yanan Wang,Yucheng Li,Zhengyu Lou,Yifan Yan,Yujing Tian,Qingjun Chen

DOI: https://doi.org/10.1080/10447318.2024.2314818

IF: 4.92

2024-02-21

International Journal of Human-Computer Interaction

Abstract:This work aims to explore the application potential of utilizing the rich medium of olfaction in Immersive Virtual Experiences (IVEs) by engaging a broader range of non-expert users. Considering the inherent properties of scent (e.g., the absence of base odors and storage challenges) and the diverse application demands in IVEs, we introduce OdorCarousel . This design tool encompasses (1) a tiny, lightweight odor-emitting device that integrates with VR headsets and can store 25 distinct aromas . We conducted user-involved technical tests on scent release performance, focusing on identifying odor type, intensity, and transitions. (2) Based on two types of smell interactions in IVEs (active and passive), we devised and implemented three Unreal Engine-based olfactory interaction blueprints and user interfaces facilitating design . A case study illustrates the operation and design process of using OdorCarousel . We recruited 17 participants for a workshop-based user study, successfully executing six concept designs validating the usability and feasibility of OdorCarousel . Finally, we analyzed the design results and the olfactory interaction intentions, discussing the multi-dimensional potential and considerations of smell-enhanced virtual experiences and OdorCarousel , providing design guidance for future works.

computer science, cybernetics,ergonomics
An olfactory display for virtual reality glasses

Marcelo de Paiva Guimarães,James Miranda Martins,Diego Roberto Colombo Dias,Rita de Fátima Rodrigues Guimarães,Bruno Barberi Gnecco

DOI: https://doi.org/10.1007/s00530-022-00908-8

IF: 3.9

2022-03-14

Multimedia Systems

Abstract:Olfaction has not been explored in virtual reality environments to the same extent as the visual and auditory senses. Much less research has been done with olfactory devices, and very few of them can be easily integrated into virtual reality applications. The inclusion of odor into virtual reality simulations using a chemical device involves challenges such as possible diffusion into undesired areas, slow dissipation, the definition of various parameters (e.g., concentration, frequency, and duration), and an appropriate software solution for controlling the diffusion of the odor. This paper aims to present a non-intrusive, mobile, low cost and wearable olfactory display, and a software service that allows the developer to easily create applications that include olfactory stimuli integrated with virtual reality headset glasses. We also present a case study conducted with 32 people to evaluate their satisfaction when using the olfactory display. Our findings indicate that our solution works as expected, producing odor properly and being easy to integrate to applications.

computer science, information systems, theory & methods
Odor Emoticon: an Olfactory Application That Conveys Emotions.

Wei Xiang,Shi Chen,Lingyun Sun,Shiwei Cheng,V. Michael Bove

DOI: https://doi.org/10.1016/j.ijhcs.2016.04.001

IF: 4.866

2016-01-01

International Journal of Human-Computer Studies

Abstract:Olfaction is an associative and emotional sense. The brain processes odors together with internal states, and odor-related memories contain strong emotional contents. This study focuses on people's emotional interpretations of odors, and proposes an olfactory application that uses odors as emoticons to convey emotions. This application offers an olfactory route for emotion communication, which can enhance communication experiences. Nine odor emoticons were designed, and validated through experiments. The effects of odor emoticons were also examined. A prototype system—Olfacticon—that emits odor emoticons was developed and applied in two contexts: online text chatting and voicemail receiving. Results suggested that odor emoticons induced more chatting, were easy to use, and helped participants perceive and convey emotions.
Advances in olfactory augmented virtual reality towards future metaverse applications

Zixuan Zhang,Xinge Guo,Chengkuo Lee

DOI: https://doi.org/10.1038/s41467-024-50261-9

2024-07-31

Abstract:Recent advances in virtual reality technologies accelerate the immersive interaction between human and augmented 3D virtual worlds. Here, the authors discuss olfactory feedback technologies that facilitate interaction with real and virtual objects and the evolution of wearable devices for immersive VR/AR applications.
Smell of Fire Increases Behavioural Realism in Virtual Reality: A Case Study on a Recreated MGM Grand Hotel Fire

Humayun Khan,Daniel Nilsson

DOI: https://doi.org/10.48550/arXiv.2311.09246

IF: 6.4588

2023-11-13

Human-Computer Interaction

Abstract:Virtual reality allows creating highly immersive visual and auditory experiences, making users feel physically present in the environment. This makes it an ideal platform to simulate dangerous scenarios, including fire evacuation, and study human behaviour without exposing users to harmful elements. However, human perception of the surroundings is based on the integration of multiple sensory cues (visual, auditory, tactile, or/and olfactory) present in the environment. When some of the sensory stimuli are missing in the virtual experience, it can break the illusion of being there in the environment and could lead to actions that deviate from normal behaviour. In this work, we added an olfactory cue in a well-documented historic hotel fire scenario that was recreated in VR, and examined the effects of the olfactory cue on human behaviour. We conducted a between subject study on 40 naive participants. Our results show that the addition of the olfactory cue could increase behavioural realism. We found that 80% of the studied actions for the VR with olfactory cue condition matched the ones performed by the survivors. In comparison, only 40% of the participants' actions for VR only condition were similar to the survivors.
The Power of Odor Persuasion: The Incorporation of Olfactory Cues in Virtual Environments for Personalized Relaxation

Silvia Francesca Maria Pizzoli,Dario Monzani,Ketti Mazzocco,Emanuela Maggioni,Gabriella Pravettoni

DOI: https://doi.org/10.1177/17456916211014196

2021-11-09

Perspectives on Psychological Science

Abstract:Olfaction is the most ancient sense and is directly connected with emotional areas in the brain. It gives rise to perception linked to emotion both in everyday life and in memory-recall activities. Despite its emotional primacy in perception and its role in sampling the real physical world, olfaction is rarely used in clinical psychological settings because it relies on stimuli that are difficult to deliver. However, recent developments in virtual-reality tools are creating novel possibilities for the engagement of the sense of smell in this field. In this article, we present the relevant features of olfaction for relaxation purposes and then discuss possible future applications of involving olfaction in virtual-reality interventions for relaxation. We also discuss clinical applications, the potential of new tools, and current obstacles and limitations.

psychology, multidisciplinary
Customer Engagement in Multi-Sensory Virtual Reality Advertising: The Effect of Sound and Scent Congruence

Malaika Brengman,Kim Willems,Laurens De Gauquier

DOI: https://doi.org/10.3389/fpsyg.2022.747456

2022-03-21

Abstract:Despite the power of VR in immersing viewers in an experience, it generally only targets viewers via visual and auditory cues. Human beings use more senses to gather information, so expectedly, the full potential of this medium is currently not yet tapped. This study contributes in answering two research questions: (1) How can conventional VR ads be enriched by also addressing the forgotten sense of smell?; and (2) Does doing so indeed instill more engaging experiences? A 2 × 3 between-subjects study (n = 235) is conducted, whereby an existing branded VR commercial (Boursin Sensorium Experience) is augmented with "sound" (on/off) and (congruent/incongruent/no) "scents." The power of these sensory augmentations is evaluated by inspecting emotional, cognitive and conative dimensions of customer engagement. The results identify product-scent congruence (with sound) as a deal-maker, albeit product-scent incongruence is not necessarily a deal-breaker. The article concludes with further research avenues and a translation into managerial implications.
Framework for Microdosing Odors in Virtual Reality for Psychophysiological Stress Training

Daniel Anheuer,Brid Karacan,Lara Herzog,Nora Weigel,Silja Meyer-Nieberg,Thomas Gebhardt,Jessica Freiherr,Martin Richter,Armin Leopold,Monika Eder,Marko Hofmann,Karl-Heinz Renner,Cornelia Küsel

DOI: https://doi.org/10.3390/s24217046

IF: 3.9

2024-11-01

Sensors

Abstract:To better cope with stress in emergencies, emergency personnel undergo virtual reality (VR) stress training. Such training typically includes visual, auditory and sometimes tactile impressions, whereas olfactory stimuli are mostly neglected. This concept paper therefore examines whether odors might be beneficial for further enhancing the experience of presence and immersion into a simulated environment. The aim is to demonstrate the benefits of VR civilian stress training for emergency personnel and to investigate the role of odors as stressors by manipulating the degree of perceived psychophysiological stress via olfactory impressions. Moreover, the current paper presents the development and validation of a convenient and portable fragrance dosing system that allows personalized odor presentation in VR. The presented system can transport reproducible small quantities of an air-fragrance mixture close to the human nose using piezoelectric stainless steel micropumps. The results of the fluidic system validation indicate that the micropump is suitable for releasing odors close to the nose with constant amounts of odor presentation. Furthermore, the theoretical background and the planned experimental design of VR stress training, including odor presentation via olfactory VR technology, are elucidated.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Aroma Release of Olfactory Displays Based on Audio-Visual Content

Safaa Alraddadi,Fahad Alqurashi,Georgios Tsaramirsis,Amany Al Luhaybi,Seyed M. Buhari

DOI: https://doi.org/10.3390/app9224866

2019-11-14

Applied Sciences

Abstract:Variant approaches used to release scents in most recent olfactory displays rely on time for decision making. The applicability of such an approach is questionable in scenarios like video games or virtual reality applications, where the specific content is dynamic in nature and thus not known in advance. All of these are required to enhance the experience and involvement of the user while watching or participating virtually in 4D cinemas or fun parks, associated with short films. Recently, associating the release of scents to the visual content of the scenario has been studied. This research enhances one such work by considering the auditory content along with the visual content. Minecraft, a computer game, was used to collect the necessary dataset with 1200 audio segments. The Inception v3 model was used to classified the sound and image dataset. Further ground truth classification on this dataset resulted in four classes: grass, fire, thunder, and zombie. Higher accuracies of 91% and 94% were achieved using the transfer learning approach for the sound and image models, respectively.
Sniff AI: Is My 'Spicy' Your 'Spicy'? Exploring LLM's Perceptual Alignment with Human Smell Experiences

Shu Zhong,Zetao Zhou,Christopher Dawes,Giada Brianz,Marianna Obrist

2024-11-11

Abstract:Aligning AI with human intent is important, yet perceptual alignment-how AI interprets what we see, hear, or smell-remains underexplored. This work focuses on olfaction, human smell experiences. We conducted a user study with 40 participants to investigate how well AI can interpret human descriptions of scents. Participants performed "sniff and describe" interactive tasks, with our designed AI system attempting to guess what scent the participants were experiencing based on their descriptions. These tasks evaluated the Large Language Model's (LLMs) contextual understanding and representation of scent relationships within its internal states - high-dimensional embedding space. Both quantitative and qualitative methods were used to evaluate the AI system's performance. Results indicated limited perceptual alignment, with biases towards certain scents, like lemon and peppermint, and continued failing to identify others, like rosemary. We discuss these findings in light of human-AI alignment advancements, highlighting the limitations and opportunities for enhancing HCI systems with multisensory experience integration.

Computation and Language,Human-Computer Interaction
Sounds of scents: olfactory-auditory correspondences in the online purchase experience for perfume

Mehdi Mahdavi,Belem Barbosa,Zaíla Oliveira,Valentina Chkoniya

DOI: https://doi.org/10.7819/rbgn.v22i4.4083

2020-10-01

Review of Business Management

Abstract:Purpose – Perfume is arguably one of the most challenging experience products offered online. This article explores how the associations between the human senses of olfaction and audition can help consumers recognize the characteristics of the scent in the absence of the real scent. Method – Given the scarcity of contributions regarding online shopping behavior for perfume, an exploratory qualitative approach was implemented. Twenty-seven in-depth interviews were conducted among individuals from three countries with prior experience of purchasing perfume online. Results –The study highlights the associations made by the interviewees between the types of sounds/voice and types of scents and the complementary role of these cues in online shopping for perfume. Practical implications – Both e-sellers and e-buyers can benefit from the findings of this research. In fact, it is likely that e-shoppers decide to either consider or ignore an unknown perfume for purchase based on the scent signals perceived from sounds, which can provide guidance for e-sellers as well.

management,business
Exploring Potential Scenarios and Design Implications Through a Camera-like Physical Odor Capture Prototype.

Qi Lu,Wan Liang,Hao Wu,Hoiian Wong,Haipeng Mi,Yingqing Xu

DOI: https://doi.org/10.1145/3357236.3395434

2020-01-01

Abstract:Recently, researchers have become increasingly interested in finding new input methods for olfactory interfaces. Physical odor capture is a potential solution to this issue and, in order to make it more accessible for users, we designed a portable and fast smell capture prototype based on headspace technology and inspired by point-and-shoot cameras. We conducted a two-week diary study with 13 participants, in which they were allowed to freely use the prototype for odor capture activities. Through diary and interview feedback, we summarized factors such as the motivations of capturing, the collected odor types, and perceptual effects of odor replay. We found that the capture activities can positively affect user emotions, memory, or perception. User preferences on device parameters were also gathered to guide further design iterations. Physical odor capture has many potential applications in daily-life and other implications resulting from the study have been proposed for further research.
Smell and Emotion: Recognising emotions in smell-related artworks

Vishal Patoliya,Mathias Zinnen,Andreas Maier,Vincent Christlein

2024-07-05

Abstract:Emotions and smell are underrepresented in digital art history. In this exploratory work, we show that recognising emotions from smell-related artworks is technically feasible but has room for improvement. Using style transfer and hyperparameter optimization we achieve a minor performance boost and open up the field for future extensions.

Computer Vision and Pattern Recognition
The Emotional and Chromatic Layers of Urban Smells

Daniele Quercia,Luca Maria Aiello,Rossano Schifanella

DOI: https://doi.org/10.48550/arXiv.1605.06721

2016-05-22

Abstract:People are able to detect up to 1 trillion odors. Yet, city planning is concerned only with a few bad odors, mainly because odors are currently captured only through complaints made by urban dwellers. To capture both good and bad odors, we resort to a methodology that has been recently proposed and relies on tagging information of geo-referenced pictures. In doing so for the cities of London and Barcelona, this work makes three new contributions. We study 1) how the urban smellscape changes in time and space; 2) which emotions people share at places with specific smells; and 3) what is the color of a smell, if it exists. Without social media data, insights about those three aspects have been difficult to produce in the past, further delaying the creation of urban restorative experiences.

Social and Information Networks,Computers and Society
Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement

Yiming Liu,Shengxin Jia,Chun Ki Yiu,Wooyoung Park,Zhenlin Chen,Jin Nan,Xingcan Huang,Hongting Chen,Wenyang Li,Yuyu Gao,Weike Song,Tomoyuki Yokota,Takao Someya,Zhao Zhao,Yuhang Li,Xinge Yu

DOI: https://doi.org/10.1038/s41467-024-48884-z

IF: 16.6

2024-05-25

Nature Communications

Abstract:Abstract Olfaction feedback systems could be utilized to stimulate human emotion, increase alertness, provide clinical therapy, and establish immersive virtual environments. Currently, the reported olfaction feedback technologies still face a host of formidable challenges, including human perceivable delay in odor manipulation, unwieldy dimensions, and limited number of odor supplies. Herein, we report a general strategy to solve these problems, which associates with a wearable, high-performance olfactory interface based on miniaturized odor generators (OGs) with advanced artificial intelligence (AI) algorithms. The OGs serve as the core technology of the intelligent olfactory interface, which exhibit milestone advances in millisecond-level response time, milliwatt-scale power consumption, and the miniaturized size. Empowered by robust AI algorithms, the olfactory interface shows its great potentials in latency-free mixed reality (MR) and fast olfaction enhancement, thereby establishing a bridge between electronics and users for broad applications ranging from entertainment, to education, to medical treatment, and to human machine interfaces.

multidisciplinary sciences

What's That Smell?

Unveiling aromas: Virtual reality and scent identification for sensory analysis

ScentClue: Enhancing Story Engagement in Virtual Reality Through Hedonically Varied Olfactory Hints

Scenting Entertainment: Virtual Reality Storytelling, Theme Park Rides, Gambling, and Video-Gaming

Odour enhances the sense of presence in a virtual reality environment

Soft, miniaturized, wireless olfactory interface for virtual reality

OdorCarousel: A Design Tool for Customizing Smell-Enhanced Virtual Experiences

An olfactory display for virtual reality glasses

Odor Emoticon: an Olfactory Application That Conveys Emotions.

Advances in olfactory augmented virtual reality towards future metaverse applications

Smell of Fire Increases Behavioural Realism in Virtual Reality: A Case Study on a Recreated MGM Grand Hotel Fire

The Power of Odor Persuasion: The Incorporation of Olfactory Cues in Virtual Environments for Personalized Relaxation

Customer Engagement in Multi-Sensory Virtual Reality Advertising: The Effect of Sound and Scent Congruence

Framework for Microdosing Odors in Virtual Reality for Psychophysiological Stress Training

Aroma Release of Olfactory Displays Based on Audio-Visual Content

Sniff AI: Is My 'Spicy' Your 'Spicy'? Exploring LLM's Perceptual Alignment with Human Smell Experiences

Sounds of scents: olfactory-auditory correspondences in the online purchase experience for perfume

Exploring Potential Scenarios and Design Implications Through a Camera-like Physical Odor Capture Prototype.

Smell and Emotion: Recognising emotions in smell-related artworks

The Emotional and Chromatic Layers of Urban Smells

Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement