GustosonicSense: Towards understanding the design of playful gustosonic eating experiences

Yan Wang,Humphrey O. Obie,Zhuying Li,Flora D. Salim,John Grundy,Florian 'Floyd' Mueller
2024-03-16
Abstract:The pleasure that often comes with eating can be further enhanced with intelligent technology, as the field of human-food interaction suggests. However, knowledge on how to design such pleasure-supporting eating systems is limited. To begin filling this knowledge gap, we designed "GustosonicSense", a novel gustosonic eating system that utilizes wireless earbuds for sensing different eating and drinking actions with a machine learning algorithm and trigger playful sounds as a way to facilitate pleasurable eating experiences. We present the findings from our design and a study that revealed how we can support the "stimulation", "hedonism", and "reflexivity" for playful human-food interactions. Ultimately, with our work, we aim to support interaction designers in facilitating playful experiences with food.
Human-Computer Interaction,Multimedia
What problem does this paper attempt to address?
The paper aims to explore how to enhance the enjoyment of dietary experiences through technology, particularly by promoting pleasant dining interactions via smart technology. The research team designed an innovative system called "GustosonicSense," which uses wireless earbuds to sense different eating actions and triggers amusing sound effects through machine learning algorithms to enhance the fun in the dining experience. Specifically, the goals of the study include: 1. **Design an innovative system**: Developed a mobile and unobtrusive GustosonicSense system that can recognize different types of eating behaviors through wireless earbuds and play corresponding amusing sounds based on these behaviors. 2. **Understand user experience**: Collected qualitative data through a field study to understand users' feelings and experiences when using the system in real-life scenarios. This study revealed how to support "stimulation," "enjoyment," and "reflection" during the eating process. 3. **Contribute to design practice**: Provided specific insights for designers and developers on how to create future smart wearable systems to sense eating behaviors, promote enjoyable experiences, and offer sound enhancements. 4. **Advance theoretical development**: Proposed three design implications to guide professionals and designers interested in developing enjoyable dining experiences. In summary, this study aims to fill the knowledge gap on how to design systems that support enjoyable dining experiences and hopes to inspire practitioners in various fields, such as entertainment developers, food designers, and headphone manufacturers, through its work.